{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "# TensorFlow Classification"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Data\n",
    "\n",
    "https://archive.ics.uci.edu/ml/datasets/pima+indians+diabetes\n",
    "https://www.kaggle.com/uciml/pima-indians-diabetes-database\n",
    "\n",
    "1. Title: Pima Indians Diabetes Database\n",
    "\n",
    "2. Sources:\n",
    "   (a) Original owners: National Institute of Diabetes and Digestive and\n",
    "                        Kidney Diseases\n",
    "   (b) Donor of database: Vincent Sigillito (vgs@aplcen.apl.jhu.edu)\n",
    "                          Research Center, RMI Group Leader\n",
    "                          Applied Physics Laboratory\n",
    "                          The Johns Hopkins University\n",
    "                          Johns Hopkins Road\n",
    "                          Laurel, MD 20707\n",
    "                          (301) 953-6231\n",
    "   (c) Date received: 9 May 1990\n",
    "\n",
    "3. Past Usage:\n",
    "    1. Smith,~J.~W., Everhart,~J.~E., Dickson,~W.~C., Knowler,~W.~C., \\&\n",
    "       Johannes,~R.~S. (1988). Using the ADAP learning algorithm to forecast\n",
    "       the onset of diabetes mellitus.  In {\\it Proceedings of the Symposium\n",
    "       on Computer Applications and Medical Care} (pp. 261--265).  IEEE\n",
    "       Computer Society Press.\n",
    "\n",
    "       The diagnostic, binary-valued variable investigated is whether the\n",
    "       patient shows signs of diabetes according to World Health Organization\n",
    "       criteria (i.e., if the 2 hour post-load plasma glucose was at least \n",
    "       200 mg/dl at any survey  examination or if found during routine medical\n",
    "       care).   The population lives near Phoenix, Arizona, USA.\n",
    "\n",
    "       Results: Their ADAP algorithm makes a real-valued prediction between\n",
    "       0 and 1.  This was transformed into a binary decision using a cutoff of \n",
    "       0.448.  Using 576 training instances, the sensitivity and specificity\n",
    "       of their algorithm was 76% on the remaining 192 instances.\n",
    "\n",
    "4. Relevant Information:\n",
    "      Several constraints were placed on the selection of these instances from\n",
    "      a larger database.  In particular, all patients here are females at\n",
    "      least 21 years old of Pima Indian heritage.  ADAP is an adaptive learning\n",
    "      routine that generates and executes digital analogs of perceptron-like\n",
    "      devices.  It is a unique algorithm; see the paper for details.\n",
    "\n",
    "5. Number of Instances: 768\n",
    "\n",
    "6. Number of Attributes: 8 plus class \n",
    "\n",
    "    7. For Each Attribute: (all numeric-valued)\n",
    "       1. Number of times pregnant\n",
    "       2. Plasma glucose concentration a 2 hours in an oral glucose tolerance test\n",
    "       3. Diastolic blood pressure (mm Hg)\n",
    "       4. Triceps skin fold thickness (mm)\n",
    "       5. 2-Hour serum insulin (mu U/ml)\n",
    "       6. Body mass index (weight in kg/(height in m)^2)\n",
    "       7. Diabetes pedigree function\n",
    "       8. Age (years)\n",
    "       9. Class variable (0 or 1)\n",
    "\n",
    "8. Missing Attribute Values: Yes\n",
    "\n",
    "9. Class Distribution: (class value 1 is interpreted as \"tested positive for\n",
    "   diabetes\")\n",
    "\n",
    "   Class Value  Number of instances\n",
    "   0            500\n",
    "   1            268\n",
    "\n",
    "10. Brief statistical analysis:\n",
    "\n",
    "        Attribute number:    Mean:   Standard Deviation:\n",
    "        1.                     3.8     3.4\n",
    "        2.                   120.9    32.0\n",
    "        3.                    69.1    19.4\n",
    "        4.                    20.5    16.0\n",
    "        5.                    79.8   115.2\n",
    "        6.                    32.0     7.9\n",
    "        7.                     0.5     0.3\n",
    "        8.                    33.2    11.8"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "diabetes = pd.read_csv('pima-indians-diabetes.csv')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Number_pregnant</th>\n",
       "      <th>Glucose_concentration</th>\n",
       "      <th>Blood_pressure</th>\n",
       "      <th>Triceps</th>\n",
       "      <th>Insulin</th>\n",
       "      <th>BMI</th>\n",
       "      <th>Pedigree</th>\n",
       "      <th>Age</th>\n",
       "      <th>Class</th>\n",
       "      <th>Group</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>6</td>\n",
       "      <td>0.743719</td>\n",
       "      <td>0.590164</td>\n",
       "      <td>0.353535</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.500745</td>\n",
       "      <td>0.234415</td>\n",
       "      <td>50</td>\n",
       "      <td>1</td>\n",
       "      <td>B</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>1</td>\n",
       "      <td>0.427136</td>\n",
       "      <td>0.540984</td>\n",
       "      <td>0.292929</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.396423</td>\n",
       "      <td>0.116567</td>\n",
       "      <td>31</td>\n",
       "      <td>0</td>\n",
       "      <td>C</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>8</td>\n",
       "      <td>0.919598</td>\n",
       "      <td>0.524590</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.347243</td>\n",
       "      <td>0.253629</td>\n",
       "      <td>32</td>\n",
       "      <td>1</td>\n",
       "      <td>B</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1</td>\n",
       "      <td>0.447236</td>\n",
       "      <td>0.540984</td>\n",
       "      <td>0.232323</td>\n",
       "      <td>0.111111</td>\n",
       "      <td>0.418778</td>\n",
       "      <td>0.038002</td>\n",
       "      <td>21</td>\n",
       "      <td>0</td>\n",
       "      <td>B</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0</td>\n",
       "      <td>0.688442</td>\n",
       "      <td>0.327869</td>\n",
       "      <td>0.353535</td>\n",
       "      <td>0.198582</td>\n",
       "      <td>0.642325</td>\n",
       "      <td>0.943638</td>\n",
       "      <td>33</td>\n",
       "      <td>1</td>\n",
       "      <td>C</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Number_pregnant  Glucose_concentration  Blood_pressure   Triceps   Insulin  \\\n",
       "0                6               0.743719        0.590164  0.353535  0.000000   \n",
       "1                1               0.427136        0.540984  0.292929  0.000000   \n",
       "2                8               0.919598        0.524590  0.000000  0.000000   \n",
       "3                1               0.447236        0.540984  0.232323  0.111111   \n",
       "4                0               0.688442        0.327869  0.353535  0.198582   \n",
       "\n",
       "        BMI  Pedigree  Age  Class Group  \n",
       "0  0.500745  0.234415   50      1     B  \n",
       "1  0.396423  0.116567   31      0     C  \n",
       "2  0.347243  0.253629   32      1     B  \n",
       "3  0.418778  0.038002   21      0     B  \n",
       "4  0.642325  0.943638   33      1     C  "
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "diabetes.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Index(['Number_pregnant', 'Glucose_concentration', 'Blood_pressure', 'Triceps',\n",
       "       'Insulin', 'BMI', 'Pedigree', 'Age', 'Class', 'Group'],\n",
       "      dtype='object')"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "diabetes.columns"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Clean the Data"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "cols_to_norm = ['Number_pregnant', 'Glucose_concentration', 'Blood_pressure', 'Triceps',\n",
    "       'Insulin', 'BMI', 'Pedigree']"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Normalize**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "diabetes[cols_to_norm] = diabetes[cols_to_norm].apply(lambda x: (x - x.min()) / (x.max() - x.min()))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Number_pregnant</th>\n",
       "      <th>Glucose_concentration</th>\n",
       "      <th>Blood_pressure</th>\n",
       "      <th>Triceps</th>\n",
       "      <th>Insulin</th>\n",
       "      <th>BMI</th>\n",
       "      <th>Pedigree</th>\n",
       "      <th>Age</th>\n",
       "      <th>Class</th>\n",
       "      <th>Group</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0.352941</td>\n",
       "      <td>0.743719</td>\n",
       "      <td>0.590164</td>\n",
       "      <td>0.353535</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.500745</td>\n",
       "      <td>0.234415</td>\n",
       "      <td>50</td>\n",
       "      <td>1</td>\n",
       "      <td>B</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0.058824</td>\n",
       "      <td>0.427136</td>\n",
       "      <td>0.540984</td>\n",
       "      <td>0.292929</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.396423</td>\n",
       "      <td>0.116567</td>\n",
       "      <td>31</td>\n",
       "      <td>0</td>\n",
       "      <td>C</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0.470588</td>\n",
       "      <td>0.919598</td>\n",
       "      <td>0.524590</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.347243</td>\n",
       "      <td>0.253629</td>\n",
       "      <td>32</td>\n",
       "      <td>1</td>\n",
       "      <td>B</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>0.058824</td>\n",
       "      <td>0.447236</td>\n",
       "      <td>0.540984</td>\n",
       "      <td>0.232323</td>\n",
       "      <td>0.111111</td>\n",
       "      <td>0.418778</td>\n",
       "      <td>0.038002</td>\n",
       "      <td>21</td>\n",
       "      <td>0</td>\n",
       "      <td>B</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.688442</td>\n",
       "      <td>0.327869</td>\n",
       "      <td>0.353535</td>\n",
       "      <td>0.198582</td>\n",
       "      <td>0.642325</td>\n",
       "      <td>0.943638</td>\n",
       "      <td>33</td>\n",
       "      <td>1</td>\n",
       "      <td>C</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Number_pregnant  Glucose_concentration  Blood_pressure   Triceps   Insulin  \\\n",
       "0         0.352941               0.743719        0.590164  0.353535  0.000000   \n",
       "1         0.058824               0.427136        0.540984  0.292929  0.000000   \n",
       "2         0.470588               0.919598        0.524590  0.000000  0.000000   \n",
       "3         0.058824               0.447236        0.540984  0.232323  0.111111   \n",
       "4         0.000000               0.688442        0.327869  0.353535  0.198582   \n",
       "\n",
       "        BMI  Pedigree  Age  Class Group  \n",
       "0  0.500745  0.234415   50      1     B  \n",
       "1  0.396423  0.116567   31      0     C  \n",
       "2  0.347243  0.253629   32      1     B  \n",
       "3  0.418778  0.038002   21      0     B  \n",
       "4  0.642325  0.943638   33      1     C  "
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "diabetes.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Feature Columns"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Index(['Number_pregnant', 'Glucose_concentration', 'Blood_pressure', 'Triceps',\n",
       "       'Insulin', 'BMI', 'Pedigree', 'Age', 'Class', 'Group'],\n",
       "      dtype='object')"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "diabetes.columns "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "import tensorflow as tf"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Continuous Features\n",
    "\n",
    "* Number of times pregnant\n",
    "* Plasma glucose concentration a 2 hours in an oral glucose tolerance test\n",
    "* Diastolic blood pressure (mm Hg)\n",
    "* Triceps skin fold thickness (mm)\n",
    "* 2-Hour serum insulin (mu U/ml)\n",
    "* Body mass index (weight in kg/(height in m)^2)\n",
    "* Diabetes pedigree function"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "num_preg = tf.feature_column.numeric_column('Number_pregnant')\n",
    "plasma_gluc = tf.feature_column.numeric_column('Glucose_concentration')\n",
    "dias_press = tf.feature_column.numeric_column('Blood_pressure')\n",
    "tricep = tf.feature_column.numeric_column('Triceps')\n",
    "insulin = tf.feature_column.numeric_column('Insulin')\n",
    "bmi = tf.feature_column.numeric_column('BMI')\n",
    "diabetes_pedigree = tf.feature_column.numeric_column('Pedigree')\n",
    "age = tf.feature_column.numeric_column('Age')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Categorical Features"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "If you know the set of all possible feature values of a column and there are only a few of them, you can use categorical_column_with_vocabulary_list. If you don't know the set of possible values in advance you can use categorical_column_with_hash_bucket"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "assigned_group = tf.feature_column.categorical_column_with_vocabulary_list('Group',['A','B','C','D'])\n",
    "# Alternative\n",
    "# assigned_group = tf.feature_column.categorical_column_with_hash_bucket('Group', hash_bucket_size=10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Converting Continuous to Categorical"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "import matplotlib.pyplot as plt\n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<matplotlib.axes._subplots.AxesSubplot at 0x7f13b94ecef0>"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAXoAAAD8CAYAAAB5Pm/hAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvOIA7rQAAE69JREFUeJzt3X+QZWV95/H3JxBdM+3yQ9iu2YFsQy0hpbCOTpcxlZTVrYkZf5TEVIpAERfUZLQKd80WWwm6qdWNZRXZ9cduyl2zs8KClYSGiKzswEYpQq8mFU1mlGUGkQRwiDOLIIJDGi02g9/9457R60x3356+t+m+j+9X1S3uec5zznm+9L2fOf3cc0+nqpAktetH1nsAkqS1ZdBLUuMMeklqnEEvSY0z6CWpcQa9JDXOoJekxhn0ktQ4g16SGnfieg8A4LTTTqupqamB/Z566ik2bdq09gN6FljLxtRKLa3UAdaynD179jxWVacP6rchgn5qaordu3cP7Dc/P8/MzMzaD+hZYC0bUyu1tFIHWMtykjy0kn5O3UhS4wx6SWqcQS9JjRsY9EmuSfJokn19bTckuat77E9yV9c+leQ7fet+fy0HL0kabCUfxl4LfAT4+JGGqvqVI8+TfBA41Nf/garaOqoBSpKGMzDoq+qzSaYWW5ckwIXAK0c7LEnSqGQlf2GqC/pdVXXeUe2vAD5UVdN9/e4B/hp4EvjtqvrcEvvcAewAmJyc3DY3NzdwHAsLC0xMTAzsNw6sZWNqpZZW6gBrWc7s7OyeI/m7rKoa+ACmgH2LtH8UuKJv+bnAC7rn24CvAf9w0P63bdtWK3HnnXeuqN84sJaNqZVaWqmjylqWA+yuFWT4qq+6SXIi8EvADX3/aDxdVd/snu8BHgB+YrXHkCQNb5hvxv4c8JWqOnCkIcnpwONV9UySs4FzgAeHHONAU1feuupt91/1uhGORJI2npVcXnk98BfAuUkOJHlrt+oi4Pqjur8CuLu73PITwNur6vFRDliSdHxWctXNxUu0X7ZI203ATcMPS5I0Kn4zVpIaZ9BLUuMMeklqnEEvSY0z6CWpcQa9JDXOoJekxhn0ktQ4g16SGmfQS1LjDHpJapxBL0mNM+glqXEGvSQ1zqCXpMYZ9JLUOINekhpn0EtS4wx6SWqcQS9JjTPoJalxA4M+yTVJHk2yr6/tvUkOJrmre7y2b927ktyf5L4kv7BWA5ckrcxKzuivBbYv0v7hqtraPW4DSPJC4CLgRd02/yXJCaMarCTp+A0M+qr6LPD4Cvd3ATBXVU9X1VeB+4GXDTE+SdKQUlWDOyVTwK6qOq9bfi9wGfAksBu4oqqeSPIR4PNV9Qddv6uB/1VVn1hknzuAHQCTk5Pb5ubmBo5jYWGBiYmJY9r3Hjw0cNulnL/lpFVvO4ylahlH1rLxtFIHWMtyZmdn91TV9KB+J65y/x8F3gdU998PAm85nh1U1U5gJ8D09HTNzMwM3GZ+fp7F+l125a3Hc+gfsP+SwcddC0vVMo6sZeNppQ6wllFY1VU3VfVIVT1TVd8F/hvfn545CJzZ1/WMrk2StE5WFfRJNvctvhE4ckXOLcBFSZ6b5CzgHOAvhxuiJGkYA6duklwPzACnJTkAvAeYSbKV3tTNfuBtAFV1T5IbgS8Dh4HLq+qZtRm6JGklBgZ9VV28SPPVy/R/P/D+YQYlSRodvxkrSY0z6CWpcQa9JDXOoJekxhn0ktQ4g16SGmfQS1LjDHpJapxBL0mNM+glqXEGvSQ1zqCXpMYZ9JLUOINekhpn0EtS4wx6SWqcQS9JjTPoJalxBr0kNc6gl6TGGfSS1LiBQZ/kmiSPJtnX1/Yfknwlyd1Jbk5yctc+leQ7Se7qHr+/loOXJA124gr6XAt8BPh4X9vtwLuq6nCS3wXeBfxWt+6Bqto60lGuoakrb131tvuvet0IRyJJa2PgGX1VfRZ4/Ki2z1TV4W7x88AZazA2SdIIpKoGd0qmgF1Vdd4i6/4ncENV/UHX7x7gr4Engd+uqs8tsc8dwA6AycnJbXNzcwPHsbCwwMTExDHtew8eGrjtWjh/y0mr3napWsaRtWw8rdQB1rKc2dnZPVU1PajfSqZulpTk3wCHgT/smh4GfryqvplkG/A/kryoqp48etuq2gnsBJienq6ZmZmBx5ufn2exfpcNMf0yjP2XzKx626VqGUfWsvG0UgdYyyis+qqbJJcBrwcuqe7Xgqp6uqq+2T3fAzwA/MQIxilJWqVVBX2S7cBvAm+oqm/3tZ+e5ITu+dnAOcCDoxioJGl1Bk7dJLkemAFOS3IAeA+9q2yeC9yeBODzVfV24BXA7yT5e+C7wNur6vFFdyxJelYMDPqquniR5quX6HsTcNOwg5IkjY7fjJWkxhn0ktQ4g16SGmfQS1LjDHpJapxBL0mNM+glqXEGvSQ1zqCXpMYZ9JLUOINekhpn0EtS4wx6SWqcQS9JjTPoJalxBr0kNc6gl6TGGfSS1DiDXpIaZ9BLUuNWFPRJrknyaJJ9fW2nJrk9yd90/z2la0+S30tyf5K7k7x0rQYvSRpspWf01wLbj2q7Erijqs4B7uiWAV4DnNM9dgAfHX6YkqTVWlHQV9VngcePar4AuK57fh3wi33tH6+ezwMnJ9k8isFKko7fMHP0k1X1cPf868Bk93wL8LW+fge6NknSOkhVraxjMgXsqqrzuuVvVdXJfeufqKpTkuwCrqqqP+va7wB+q6p2H7W/HfSmdpicnNw2Nzc3cAwLCwtMTEwc07734KEV1TBq5285adXbLlXLOLKWjaeVOsBaljM7O7unqqYH9TtxiGM8kmRzVT3cTc082rUfBM7s63dG1/YDqmonsBNgenq6ZmZmBh5wfn6exfpdduWtxzv2kdh/ycyqt12qlnFkLRtPK3WAtYzCMFM3twCXds8vBT7V1/7Pu6tvXg4c6pvikSQ9y1Z0Rp/kemAGOC3JAeA9wFXAjUneCjwEXNh1vw14LXA/8G3gzSMesyTpOKwo6Kvq4iVWvWqRvgVcPsygJEmjM8wc/Q+9qSE+G7h2+6YRjkSSluYtECSpcQa9JDXOoJekxhn0ktQ4g16SGmfQS1LjDHpJapxBL0mNM+glqXEGvSQ1zqCXpMYZ9JLUOINekhpn0EtS4wx6SWqcQS9JjTPoJalxBr0kNc6gl6TGGfSS1LhV/3HwJOcCN/Q1nQ38W+Bk4NeBb3Tt766q21Y9QknSUFYd9FV1H7AVIMkJwEHgZuDNwIer6gMjGaEkaSijmrp5FfBAVT00ov1JkkZkVEF/EXB93/I7ktyd5Jokp4zoGJKkVUhVDbeD5DnA/wVeVFWPJJkEHgMKeB+wuaressh2O4AdAJOTk9vm5uYGHmthYYGJiYlj2vcePDRUDevhrJNOWLSWcbTUz2UctVJLK3WAtSxndnZ2T1VND+o3iqC/ALi8ql69yLopYFdVnbfcPqanp2v37t0DjzU/P8/MzMwx7VNX3rrC0W4c127ftGgt42ipn8s4aqWWVuoAa1lOkhUF/Simbi6mb9omyea+dW8E9o3gGJKkVVr1VTcASTYBPw+8ra/53yfZSm/qZv9R6yRJz7Khgr6qngJecFTbm4YakSRppPxmrCQ1zqCXpMYZ9JLUOINekhpn0EtS4wx6SWqcQS9JjTPoJalxBr0kNc6gl6TGGfSS1DiDXpIaN9RNzbR6ew8e4rJV3kd//1WvG/FoJLXMM3pJapxBL0mNM+glqXEGvSQ1zqCXpMYZ9JLUOINekhpn0EtS44b+wlSS/cDfAc8Ah6tqOsmpwA3AFLAfuLCqnhj2WJKk4zeqM/rZqtpaVdPd8pXAHVV1DnBHtyxJWgdrNXVzAXBd9/w64BfX6DiSpAFGca+bAj6TpID/WlU7gcmqerhb/3VgcgTH0YhMrfIeO+B9dqRxlKoabgfJlqo6mOQfAbcD/wK4papO7uvzRFWdctR2O4AdAJOTk9vm5uYGHmthYYGJiYlj2vcePDRUDeth8nnwyHdWt+35W04a6tjD/P9a7NhL/VzGUSu1tFIHWMtyZmdn9/RNmS9p6KD/gZ0l7wUWgF8HZqrq4SSbgfmqOnep7aanp2v37t0D9z8/P8/MzMwx7cOcoa6XK84/zAf3ru4XqmHPqkd9Rr/Uz2UctVJLK3WAtSwnyYqCfqg5+iSbkjz/yHPg1cA+4Bbg0q7bpcCnhjmOJGn1hp2jnwRuTnJkX39UVX+S5K+AG5O8FXgIuHDI40iSVmmooK+qB4EXL9L+TeBVw+xbG9Ni0z5XnH94RX9ExQ9ypfXhN2MlqXEGvSQ1zqCXpMYZ9JLUOINekhpn0EtS40Zxrxs9y8bxm8CS1o9n9JLUOM/o9azxrpnS+vCMXpIaZ9BLUuMMeklqnEEvSY0z6CWpcV51o7Ew7HcHvGpHP8w8o5ekxhn0ktQ4g16SGmfQS1LjDHpJapxBL0mNW3XQJzkzyZ1JvpzkniTv7Nrfm+Rgkru6x2tHN1xJ0vEa5jr6w8AVVfXFJM8H9iS5vVv34ar6wPDDkyQNa9VBX1UPAw93z/8uyb3AllENTJI0GiOZo08yBbwE+ELX9I4kdye5JskpoziGJGl1UlXD7SCZAP438P6q+mSSSeAxoID3AZur6i2LbLcD2AEwOTm5bW5ubuCxFhYWmJiYOKZ978FDQ9WwHiafB498Z71HMRrjUMv5W05aUb+lXmPjppU6wFqWMzs7u6eqpgf1Gyrok/wosAv4dFV9aJH1U8Cuqjpvuf1MT0/X7t27Bx5vfn6emZmZY9rH8W+oXnH+YT64t41bDY1DLSu9181Sr7Fx00odYC3LSbKioB/mqpsAVwP39od8ks193d4I7FvtMSRJwxvmNOxngDcBe5Pc1bW9G7g4yVZ6Uzf7gbcNNUJJ0lCGuermz4Assuq21Q9HkjRqG3tiVdoAhvkMyPvgayPwFgiS1DiDXpIa59SNfiisdPrlivMPc9kYXq4rLcczeklqnEEvSY0z6CWpcc7RSxvUMJd1Xrt90whHonHnGb0kNc4zemkNjeMN99Qez+glqXEGvSQ1zqkbqUF7Dx4a6otf3qOnLZ7RS1LjDHpJapxTN5KOsV5XCzlltDY8o5ekxhn0ktQ4g16SGmfQS1LjDHpJatyaXXWTZDvwn4ATgI9V1VVrdSxJbVjsap+V/tUvr9hZ2pqc0Sc5AfjPwGuAFwIXJ3nhWhxLkrS8tZq6eRlwf1U9WFX/D5gDLlijY0mSlrFWUzdbgK/1LR8AfmqNjiVJQ33Ja9hpn2H++PyzMeWUqhr9TpNfBrZX1a91y28Cfqqq3tHXZwewo1s8F7hvBbs+DXhsxMNdL9ayMbVSSyt1gLUs559U1emDOq3VGf1B4My+5TO6tu+pqp3AzuPZaZLdVTU9/PDWn7VsTK3U0kodYC2jsFZz9H8FnJPkrCTPAS4CblmjY0mSlrEmZ/RVdTjJO4BP07u88pqqumctjiVJWt6aXUdfVbcBt414t8c11bPBWcvG1EotrdQB1jK0NfkwVpK0cXgLBElq3IYN+iRnJrkzyZeT3JPknV37qUluT/I33X9PWe+xDpLkHyT5yyT/p6vl33XtZyX5QpL7k9zQfXC94SU5IcmXkuzqlse1jv1J9ia5K8nurm3sXl8ASU5O8okkX0lyb5KfHsdakpzb/TyOPJ5M8htjWsu/6t7v+5Jc3+XAurxXNmzQA4eBK6rqhcDLgcu72yhcCdxRVecAd3TLG93TwCur6sXAVmB7kpcDvwt8uKr+KfAE8NZ1HOPxeCdwb9/yuNYBMFtVW/sueRvH1xf07iv1J1X1k8CL6f18xq6Wqrqv+3lsBbYB3wZuZsxqSbIF+JfAdFWdR++ilItYr/dKVY3FA/gU8PP0vli1uWvbDNy33mM7zjp+DPgivW8KPwac2LX/NPDp9R7fCsZ/Br032iuBXUDGsY5urPuB045qG7vXF3AS8FW6z9zGuZajxv9q4M/HsRa+f3eAU+ld9LIL+IX1eq9s5DP670kyBbwE+AIwWVUPd6u+Dkyu07COSzfdcRfwKHA78ADwrao63HU5QO/FsdH9R+A3ge92yy9gPOsAKOAzSfZ039SG8Xx9nQV8A/jv3ZTax5JsYjxr6XcRcH33fKxqqaqDwAeAvwUeBg4Be1in98qGD/okE8BNwG9U1ZP966r3z+JYXDZUVc9U79fRM+jd9O0n13lIxy3J64FHq2rPeo9lRH62ql5K7y6rlyd5Rf/KMXp9nQi8FPhoVb0EeIqjpjbGqBYAurnrNwB/fPS6cail+wzhAnr/CP9jYBOwfb3Gs6GDPsmP0gv5P6yqT3bNjyTZ3K3fTO8MeWxU1beAO+n92nZykiPfZTjmNhEb0M8Ab0iyn94dSV9Jb2543OoAvnfWRVU9Sm8e+GWM5+vrAHCgqr7QLX+CXvCPYy1HvAb4YlU90i2PWy0/B3y1qr5RVX8PfJLe+2dd3isbNuiTBLgauLeqPtS36hbg0u75pfTm7je0JKcnObl7/jx6nzXcSy/wf7nrtuFrqap3VdUZVTVF79fqP62qSxizOgCSbEry/CPP6c0H72MMX19V9XXga0nO7ZpeBXyZMaylz8V8f9oGxq+WvwVenuTHuiw78jNZl/fKhv3CVJKfBT4H7OX788HvpjdPfyPw48BDwIVV9fi6DHKFkvwz4Dp6n7z/CHBjVf1OkrPpnRmfCnwJ+NWqenr9RrpySWaAf11Vrx/HOrox39wtngj8UVW9P8kLGLPXF0CSrcDHgOcADwJvpnutMX61bKIXlGdX1aGubex+Lt1l1L9C7wrCLwG/Rm9O/ll/r2zYoJckjcaGnbqRJI2GQS9JjTPoJalxBr0kNc6gl6TGGfSS1DiDXpIaZ9BLUuP+P6NA9/A+oAINAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "diabetes['Age'].hist(bins=20)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "age_buckets = tf.feature_column.bucketized_column(age, boundaries=[20,30,40,50,60,70,80])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Putting them together"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "feat_cols = [num_preg ,plasma_gluc,dias_press ,tricep ,insulin,bmi,diabetes_pedigree ,assigned_group, age_buckets]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Train Test Split"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Number_pregnant</th>\n",
       "      <th>Glucose_concentration</th>\n",
       "      <th>Blood_pressure</th>\n",
       "      <th>Triceps</th>\n",
       "      <th>Insulin</th>\n",
       "      <th>BMI</th>\n",
       "      <th>Pedigree</th>\n",
       "      <th>Age</th>\n",
       "      <th>Class</th>\n",
       "      <th>Group</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0.352941</td>\n",
       "      <td>0.743719</td>\n",
       "      <td>0.590164</td>\n",
       "      <td>0.353535</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.500745</td>\n",
       "      <td>0.234415</td>\n",
       "      <td>50</td>\n",
       "      <td>1</td>\n",
       "      <td>B</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0.058824</td>\n",
       "      <td>0.427136</td>\n",
       "      <td>0.540984</td>\n",
       "      <td>0.292929</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.396423</td>\n",
       "      <td>0.116567</td>\n",
       "      <td>31</td>\n",
       "      <td>0</td>\n",
       "      <td>C</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0.470588</td>\n",
       "      <td>0.919598</td>\n",
       "      <td>0.524590</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.347243</td>\n",
       "      <td>0.253629</td>\n",
       "      <td>32</td>\n",
       "      <td>1</td>\n",
       "      <td>B</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>0.058824</td>\n",
       "      <td>0.447236</td>\n",
       "      <td>0.540984</td>\n",
       "      <td>0.232323</td>\n",
       "      <td>0.111111</td>\n",
       "      <td>0.418778</td>\n",
       "      <td>0.038002</td>\n",
       "      <td>21</td>\n",
       "      <td>0</td>\n",
       "      <td>B</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.688442</td>\n",
       "      <td>0.327869</td>\n",
       "      <td>0.353535</td>\n",
       "      <td>0.198582</td>\n",
       "      <td>0.642325</td>\n",
       "      <td>0.943638</td>\n",
       "      <td>33</td>\n",
       "      <td>1</td>\n",
       "      <td>C</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Number_pregnant  Glucose_concentration  Blood_pressure   Triceps   Insulin  \\\n",
       "0         0.352941               0.743719        0.590164  0.353535  0.000000   \n",
       "1         0.058824               0.427136        0.540984  0.292929  0.000000   \n",
       "2         0.470588               0.919598        0.524590  0.000000  0.000000   \n",
       "3         0.058824               0.447236        0.540984  0.232323  0.111111   \n",
       "4         0.000000               0.688442        0.327869  0.353535  0.198582   \n",
       "\n",
       "        BMI  Pedigree  Age  Class Group  \n",
       "0  0.500745  0.234415   50      1     B  \n",
       "1  0.396423  0.116567   31      0     C  \n",
       "2  0.347243  0.253629   32      1     B  \n",
       "3  0.418778  0.038002   21      0     B  \n",
       "4  0.642325  0.943638   33      1     C  "
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "diabetes.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 768 entries, 0 to 767\n",
      "Data columns (total 10 columns):\n",
      "Number_pregnant          768 non-null float64\n",
      "Glucose_concentration    768 non-null float64\n",
      "Blood_pressure           768 non-null float64\n",
      "Triceps                  768 non-null float64\n",
      "Insulin                  768 non-null float64\n",
      "BMI                      768 non-null float64\n",
      "Pedigree                 768 non-null float64\n",
      "Age                      768 non-null int64\n",
      "Class                    768 non-null int64\n",
      "Group                    768 non-null object\n",
      "dtypes: float64(7), int64(2), object(1)\n",
      "memory usage: 60.1+ KB\n"
     ]
    }
   ],
   "source": [
    "diabetes.info()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [],
   "source": [
    "x_data = diabetes.drop('Class',axis=1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [],
   "source": [
    "labels = diabetes['Class']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sklearn.model_selection import train_test_split"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [],
   "source": [
    "X_train, X_test, y_train, y_test = train_test_split(x_data,labels,test_size=0.33, random_state=101)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(514,)"
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "y_train.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [],
   "source": [
    "X_train = X_train.drop(labels='Group',axis=1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [],
   "source": [
    "X_test = X_test.drop(labels='Group',axis=1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Number_pregnant</th>\n",
       "      <th>Glucose_concentration</th>\n",
       "      <th>Blood_pressure</th>\n",
       "      <th>Triceps</th>\n",
       "      <th>Insulin</th>\n",
       "      <th>BMI</th>\n",
       "      <th>Pedigree</th>\n",
       "      <th>Age</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>218</th>\n",
       "      <td>0.294118</td>\n",
       "      <td>0.427136</td>\n",
       "      <td>0.606557</td>\n",
       "      <td>0.222222</td>\n",
       "      <td>0.00000</td>\n",
       "      <td>0.432191</td>\n",
       "      <td>0.489325</td>\n",
       "      <td>32</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>83</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.507538</td>\n",
       "      <td>0.532787</td>\n",
       "      <td>0.282828</td>\n",
       "      <td>0.00000</td>\n",
       "      <td>0.366617</td>\n",
       "      <td>0.067891</td>\n",
       "      <td>22</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>176</th>\n",
       "      <td>0.352941</td>\n",
       "      <td>0.427136</td>\n",
       "      <td>0.639344</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.00000</td>\n",
       "      <td>0.464978</td>\n",
       "      <td>0.129804</td>\n",
       "      <td>42</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>53</th>\n",
       "      <td>0.470588</td>\n",
       "      <td>0.884422</td>\n",
       "      <td>0.737705</td>\n",
       "      <td>0.343434</td>\n",
       "      <td>0.35461</td>\n",
       "      <td>0.502235</td>\n",
       "      <td>0.166097</td>\n",
       "      <td>58</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>117</th>\n",
       "      <td>0.294118</td>\n",
       "      <td>0.391960</td>\n",
       "      <td>0.393443</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.00000</td>\n",
       "      <td>0.502235</td>\n",
       "      <td>0.245944</td>\n",
       "      <td>25</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "     Number_pregnant  Glucose_concentration  Blood_pressure   Triceps  \\\n",
       "218         0.294118               0.427136        0.606557  0.222222   \n",
       "83          0.000000               0.507538        0.532787  0.282828   \n",
       "176         0.352941               0.427136        0.639344  0.000000   \n",
       "53          0.470588               0.884422        0.737705  0.343434   \n",
       "117         0.294118               0.391960        0.393443  0.000000   \n",
       "\n",
       "     Insulin       BMI  Pedigree  Age  \n",
       "218  0.00000  0.432191  0.489325   32  \n",
       "83   0.00000  0.366617  0.067891   22  \n",
       "176  0.00000  0.464978  0.129804   42  \n",
       "53   0.35461  0.502235  0.166097   58  \n",
       "117  0.00000  0.502235  0.245944   25  "
      ]
     },
     "execution_count": 29,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "X_train.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Keras"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 79,
   "metadata": {},
   "outputs": [],
   "source": [
    "from tensorflow.keras.models import Sequential\n",
    "from tensorflow.keras.layers import Dense,Activation\n",
    "from tensorflow.keras.optimizers import SGD,Adam\n",
    "from tensorflow.keras.utils import to_categorical"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 100,
   "metadata": {},
   "outputs": [],
   "source": [
    "model = Sequential()\n",
    "#model.add(Dense(20,input_shape = (X_train.shape[1],)))\n",
    "model.add(Dense(20,input_shape = (X_train.shape[1],), activation = 'relu'))\n",
    "model.add(Dense(10,activation = 'relu'))\n",
    "model.add(Dense(10,activation = 'relu'))\n",
    "model.add(Dense(2, activation = 'softmax'))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 101,
   "metadata": {},
   "outputs": [],
   "source": [
    "adam = Adam(0.002)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 102,
   "metadata": {},
   "outputs": [],
   "source": [
    "y_binary_train= to_categorical(y_train)\n",
    "y_binary_test = to_categorical(y_test)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 105,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [1., 0.],\n",
       "       [0., 1.],\n",
       "       [1., 0.],\n",
       "       [0., 1.]], dtype=float32)"
      ]
     },
     "execution_count": 105,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "y_binary_test"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 103,
   "metadata": {},
   "outputs": [],
   "source": [
    "model.compile(loss = 'categorical_crossentropy', optimizer = adam, metrics=['accuracy'])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 104,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train on 514 samples, validate on 254 samples\n",
      "Epoch 1/2000\n",
      "514/514 [==============================] - 1s 2ms/step - loss: 0.7077 - acc: 0.5700 - val_loss: 0.6635 - val_acc: 0.6575\n",
      "Epoch 2/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.6725 - acc: 0.6479 - val_loss: 0.6580 - val_acc: 0.6575\n",
      "Epoch 3/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.6672 - acc: 0.6479 - val_loss: 0.6551 - val_acc: 0.6575\n",
      "Epoch 4/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.6730 - acc: 0.6576 - val_loss: 0.6609 - val_acc: 0.6575\n",
      "Epoch 5/2000\n",
      "514/514 [==============================] - 0s 173us/step - loss: 0.6688 - acc: 0.6479 - val_loss: 0.6607 - val_acc: 0.6575\n",
      "Epoch 6/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.6528 - acc: 0.6498 - val_loss: 0.6661 - val_acc: 0.6575\n",
      "Epoch 7/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.6832 - acc: 0.6479 - val_loss: 0.6715 - val_acc: 0.6732\n",
      "Epoch 8/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.6613 - acc: 0.6693 - val_loss: 0.6423 - val_acc: 0.6575\n",
      "Epoch 9/2000\n",
      "514/514 [==============================] - 0s 136us/step - loss: 0.6581 - acc: 0.6304 - val_loss: 0.6393 - val_acc: 0.6575\n",
      "Epoch 10/2000\n",
      "514/514 [==============================] - 0s 91us/step - loss: 0.6559 - acc: 0.6381 - val_loss: 0.6391 - val_acc: 0.6575\n",
      "Epoch 11/2000\n",
      "514/514 [==============================] - 0s 90us/step - loss: 0.6434 - acc: 0.6479 - val_loss: 0.6355 - val_acc: 0.6575\n",
      "Epoch 12/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.6429 - acc: 0.6401 - val_loss: 0.6342 - val_acc: 0.6575\n",
      "Epoch 13/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.6437 - acc: 0.6479 - val_loss: 0.6498 - val_acc: 0.6811\n",
      "Epoch 14/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.6592 - acc: 0.6342 - val_loss: 0.6292 - val_acc: 0.6575\n",
      "Epoch 15/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.6337 - acc: 0.6440 - val_loss: 0.6311 - val_acc: 0.6378\n",
      "Epoch 16/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.6303 - acc: 0.6556 - val_loss: 0.6278 - val_acc: 0.6575\n",
      "Epoch 17/2000\n",
      "514/514 [==============================] - 0s 155us/step - loss: 0.6351 - acc: 0.6420 - val_loss: 0.6220 - val_acc: 0.6575\n",
      "Epoch 18/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.6328 - acc: 0.6440 - val_loss: 0.6238 - val_acc: 0.6457\n",
      "Epoch 19/2000\n",
      "514/514 [==============================] - 0s 284us/step - loss: 0.6325 - acc: 0.6342 - val_loss: 0.6197 - val_acc: 0.6417\n",
      "Epoch 20/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.6279 - acc: 0.6479 - val_loss: 0.6242 - val_acc: 0.6535\n",
      "Epoch 21/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.6229 - acc: 0.6576 - val_loss: 0.6141 - val_acc: 0.6575\n",
      "Epoch 22/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.6192 - acc: 0.6498 - val_loss: 0.6117 - val_acc: 0.6417\n",
      "Epoch 23/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.6185 - acc: 0.6459 - val_loss: 0.6224 - val_acc: 0.6850\n",
      "Epoch 24/2000\n",
      "514/514 [==============================] - 0s 197us/step - loss: 0.6171 - acc: 0.6595 - val_loss: 0.6062 - val_acc: 0.6496\n",
      "Epoch 25/2000\n",
      "514/514 [==============================] - 0s 264us/step - loss: 0.6297 - acc: 0.6576 - val_loss: 0.6041 - val_acc: 0.6575\n",
      "Epoch 26/2000\n",
      "514/514 [==============================] - 0s 226us/step - loss: 0.6279 - acc: 0.6595 - val_loss: 0.6155 - val_acc: 0.6575\n",
      "Epoch 27/2000\n",
      "514/514 [==============================] - 0s 224us/step - loss: 0.6272 - acc: 0.6459 - val_loss: 0.6272 - val_acc: 0.6811\n",
      "Epoch 28/2000\n",
      "514/514 [==============================] - 0s 155us/step - loss: 0.6202 - acc: 0.6342 - val_loss: 0.6017 - val_acc: 0.6575\n",
      "Epoch 29/2000\n",
      "514/514 [==============================] - 0s 300us/step - loss: 0.6059 - acc: 0.6576 - val_loss: 0.6038 - val_acc: 0.6654\n",
      "Epoch 30/2000\n",
      "514/514 [==============================] - 0s 290us/step - loss: 0.6025 - acc: 0.6615 - val_loss: 0.6037 - val_acc: 0.6772\n",
      "Epoch 31/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.6095 - acc: 0.6556 - val_loss: 0.6009 - val_acc: 0.6378\n",
      "Epoch 32/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.6073 - acc: 0.6732 - val_loss: 0.6172 - val_acc: 0.6575\n",
      "Epoch 33/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.6290 - acc: 0.6518 - val_loss: 0.6301 - val_acc: 0.6654\n",
      "Epoch 34/2000\n",
      "514/514 [==============================] - 0s 146us/step - loss: 0.6069 - acc: 0.6615 - val_loss: 0.5996 - val_acc: 0.6811\n",
      "Epoch 35/2000\n",
      "514/514 [==============================] - 0s 298us/step - loss: 0.6570 - acc: 0.6440 - val_loss: 0.6638 - val_acc: 0.6417\n",
      "Epoch 36/2000\n",
      "514/514 [==============================] - 0s 291us/step - loss: 0.6554 - acc: 0.6401 - val_loss: 0.6475 - val_acc: 0.6535\n",
      "Epoch 37/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.6474 - acc: 0.6479 - val_loss: 0.6424 - val_acc: 0.6575\n",
      "Epoch 38/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.6450 - acc: 0.6479 - val_loss: 0.6404 - val_acc: 0.6575\n",
      "Epoch 39/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.6436 - acc: 0.6479 - val_loss: 0.6394 - val_acc: 0.6575\n",
      "Epoch 40/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.6430 - acc: 0.6479 - val_loss: 0.6383 - val_acc: 0.6575\n",
      "Epoch 41/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.6397 - acc: 0.6479 - val_loss: 0.6224 - val_acc: 0.6575\n",
      "Epoch 42/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.6233 - acc: 0.6479 - val_loss: 0.6271 - val_acc: 0.6575\n",
      "Epoch 43/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.6300 - acc: 0.6479 - val_loss: 0.6148 - val_acc: 0.6575\n",
      "Epoch 44/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.6264 - acc: 0.6479 - val_loss: 0.6178 - val_acc: 0.6535\n",
      "Epoch 45/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.6170 - acc: 0.6381 - val_loss: 0.6265 - val_acc: 0.6575\n",
      "Epoch 46/2000\n",
      "514/514 [==============================] - 0s 223us/step - loss: 0.6399 - acc: 0.6342 - val_loss: 0.6359 - val_acc: 0.6378\n",
      "Epoch 47/2000\n",
      "514/514 [==============================] - 0s 202us/step - loss: 0.6184 - acc: 0.6226 - val_loss: 0.6034 - val_acc: 0.6417\n",
      "Epoch 48/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.6269 - acc: 0.6342 - val_loss: 0.6198 - val_acc: 0.6339\n",
      "Epoch 49/2000\n",
      "514/514 [==============================] - 0s 232us/step - loss: 0.6253 - acc: 0.6362 - val_loss: 0.6087 - val_acc: 0.6457\n",
      "Epoch 50/2000\n",
      "514/514 [==============================] - 0s 326us/step - loss: 0.6124 - acc: 0.6323 - val_loss: 0.6084 - val_acc: 0.6339\n",
      "Epoch 51/2000\n",
      "514/514 [==============================] - 0s 162us/step - loss: 0.6105 - acc: 0.6323 - val_loss: 0.6069 - val_acc: 0.6339\n",
      "Epoch 52/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.6080 - acc: 0.6206 - val_loss: 0.6043 - val_acc: 0.6339\n",
      "Epoch 53/2000\n",
      "514/514 [==============================] - 0s 224us/step - loss: 0.6048 - acc: 0.6362 - val_loss: 0.6007 - val_acc: 0.6339\n",
      "Epoch 54/2000\n",
      "514/514 [==============================] - 0s 329us/step - loss: 0.6067 - acc: 0.6362 - val_loss: 0.5949 - val_acc: 0.6378\n",
      "Epoch 55/2000\n",
      "514/514 [==============================] - 0s 154us/step - loss: 0.5890 - acc: 0.6362 - val_loss: 0.5817 - val_acc: 0.6299\n",
      "Epoch 56/2000\n",
      "514/514 [==============================] - 0s 174us/step - loss: 0.5864 - acc: 0.6440 - val_loss: 0.5891 - val_acc: 0.6693\n",
      "Epoch 57/2000\n",
      "514/514 [==============================] - 0s 147us/step - loss: 0.5890 - acc: 0.6576 - val_loss: 0.5804 - val_acc: 0.6575\n",
      "Epoch 58/2000\n",
      "514/514 [==============================] - 0s 177us/step - loss: 0.5871 - acc: 0.6440 - val_loss: 0.5847 - val_acc: 0.6575\n",
      "Epoch 59/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.5780 - acc: 0.6693 - val_loss: 0.5748 - val_acc: 0.6614\n",
      "Epoch 60/2000\n",
      "514/514 [==============================] - 0s 191us/step - loss: 0.5770 - acc: 0.6518 - val_loss: 0.5812 - val_acc: 0.6339\n",
      "Epoch 61/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.5762 - acc: 0.6459 - val_loss: 0.5830 - val_acc: 0.6299\n",
      "Epoch 62/2000\n",
      "514/514 [==============================] - 0s 74us/step - loss: 0.5820 - acc: 0.6440 - val_loss: 0.5716 - val_acc: 0.6417\n",
      "Epoch 63/2000\n",
      "514/514 [==============================] - 0s 91us/step - loss: 0.5740 - acc: 0.6556 - val_loss: 0.5779 - val_acc: 0.6693\n",
      "Epoch 64/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.5859 - acc: 0.6459 - val_loss: 0.5793 - val_acc: 0.6732\n",
      "Epoch 65/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.5964 - acc: 0.6576 - val_loss: 0.5744 - val_acc: 0.6575\n",
      "Epoch 66/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.5703 - acc: 0.6537 - val_loss: 0.5814 - val_acc: 0.6654\n",
      "Epoch 67/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.5725 - acc: 0.6576 - val_loss: 0.5633 - val_acc: 0.6811\n",
      "Epoch 68/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.5712 - acc: 0.6751 - val_loss: 0.5639 - val_acc: 0.6850\n",
      "Epoch 69/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.5867 - acc: 0.6556 - val_loss: 0.5692 - val_acc: 0.6654\n",
      "Epoch 70/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.5643 - acc: 0.6693 - val_loss: 0.5686 - val_acc: 0.6811\n",
      "Epoch 71/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.5618 - acc: 0.6732 - val_loss: 0.5605 - val_acc: 0.6850\n",
      "Epoch 72/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.5585 - acc: 0.6984 - val_loss: 0.5611 - val_acc: 0.6850\n",
      "Epoch 73/2000\n",
      "514/514 [==============================] - 0s 85us/step - loss: 0.5569 - acc: 0.6868 - val_loss: 0.5606 - val_acc: 0.6929\n",
      "Epoch 74/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.5552 - acc: 0.6809 - val_loss: 0.5634 - val_acc: 0.6732\n",
      "Epoch 75/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.5657 - acc: 0.6732 - val_loss: 0.5520 - val_acc: 0.6890\n",
      "Epoch 76/2000\n",
      "514/514 [==============================] - 0s 149us/step - loss: 0.5589 - acc: 0.6848 - val_loss: 0.5565 - val_acc: 0.7087\n",
      "Epoch 77/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.5661 - acc: 0.6595 - val_loss: 0.5535 - val_acc: 0.6850\n",
      "Epoch 78/2000\n",
      "514/514 [==============================] - 0s 194us/step - loss: 0.5565 - acc: 0.6868 - val_loss: 0.5441 - val_acc: 0.7205\n",
      "Epoch 79/2000\n",
      "514/514 [==============================] - 0s 189us/step - loss: 0.5640 - acc: 0.6907 - val_loss: 0.5642 - val_acc: 0.6969\n",
      "Epoch 80/2000\n",
      "514/514 [==============================] - 0s 168us/step - loss: 0.5585 - acc: 0.6770 - val_loss: 0.5724 - val_acc: 0.7008\n",
      "Epoch 81/2000\n",
      "514/514 [==============================] - 0s 203us/step - loss: 0.5450 - acc: 0.7004 - val_loss: 0.5530 - val_acc: 0.6969\n",
      "Epoch 82/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.5656 - acc: 0.6848 - val_loss: 0.5507 - val_acc: 0.6969\n",
      "Epoch 83/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.5463 - acc: 0.6848 - val_loss: 0.5407 - val_acc: 0.7087\n",
      "Epoch 84/2000\n",
      "514/514 [==============================] - 0s 148us/step - loss: 0.5439 - acc: 0.6965 - val_loss: 0.5466 - val_acc: 0.6929\n",
      "Epoch 85/2000\n",
      "514/514 [==============================] - 0s 160us/step - loss: 0.5492 - acc: 0.6887 - val_loss: 0.5892 - val_acc: 0.6890\n",
      "Epoch 86/2000\n",
      "514/514 [==============================] - 0s 195us/step - loss: 0.5454 - acc: 0.6887 - val_loss: 0.5313 - val_acc: 0.7126\n",
      "Epoch 87/2000\n",
      "514/514 [==============================] - 0s 166us/step - loss: 0.5372 - acc: 0.7023 - val_loss: 0.5285 - val_acc: 0.7126\n",
      "Epoch 88/2000\n",
      "514/514 [==============================] - 0s 184us/step - loss: 0.5314 - acc: 0.7043 - val_loss: 0.5265 - val_acc: 0.7283\n",
      "Epoch 89/2000\n",
      "514/514 [==============================] - 0s 198us/step - loss: 0.5303 - acc: 0.7140 - val_loss: 0.5232 - val_acc: 0.7205\n",
      "Epoch 90/2000\n",
      "514/514 [==============================] - 0s 187us/step - loss: 0.5398 - acc: 0.7160 - val_loss: 0.5775 - val_acc: 0.6969\n",
      "Epoch 91/2000\n",
      "514/514 [==============================] - 0s 152us/step - loss: 0.5521 - acc: 0.7160 - val_loss: 0.5721 - val_acc: 0.6654\n",
      "Epoch 92/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.5805 - acc: 0.7082 - val_loss: 0.5162 - val_acc: 0.7205\n",
      "Epoch 93/2000\n",
      "514/514 [==============================] - 0s 200us/step - loss: 0.5287 - acc: 0.7276 - val_loss: 0.5160 - val_acc: 0.7283\n",
      "Epoch 94/2000\n",
      "514/514 [==============================] - 0s 169us/step - loss: 0.5448 - acc: 0.7101 - val_loss: 0.5580 - val_acc: 0.7205\n",
      "Epoch 95/2000\n",
      "514/514 [==============================] - 0s 220us/step - loss: 0.5237 - acc: 0.7101 - val_loss: 0.5193 - val_acc: 0.7520\n",
      "Epoch 96/2000\n",
      "514/514 [==============================] - 0s 139us/step - loss: 0.5655 - acc: 0.7043 - val_loss: 0.5129 - val_acc: 0.7244\n",
      "Epoch 97/2000\n",
      "514/514 [==============================] - 0s 170us/step - loss: 0.5343 - acc: 0.7062 - val_loss: 0.5145 - val_acc: 0.7323\n",
      "Epoch 98/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.5665 - acc: 0.7101 - val_loss: 0.5382 - val_acc: 0.7205\n",
      "Epoch 99/2000\n",
      "514/514 [==============================] - 0s 165us/step - loss: 0.5401 - acc: 0.7043 - val_loss: 0.5233 - val_acc: 0.7559\n",
      "Epoch 100/2000\n",
      "514/514 [==============================] - 0s 227us/step - loss: 0.5186 - acc: 0.7374 - val_loss: 0.5205 - val_acc: 0.7559\n",
      "Epoch 101/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.5432 - acc: 0.7160 - val_loss: 0.5127 - val_acc: 0.7402\n",
      "Epoch 102/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.5363 - acc: 0.7043 - val_loss: 0.5222 - val_acc: 0.7047\n",
      "Epoch 103/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.5285 - acc: 0.7160 - val_loss: 0.5269 - val_acc: 0.7205\n",
      "Epoch 104/2000\n",
      "514/514 [==============================] - 0s 153us/step - loss: 0.5056 - acc: 0.7529 - val_loss: 0.5011 - val_acc: 0.7402\n",
      "Epoch 105/2000\n",
      "514/514 [==============================] - 0s 155us/step - loss: 0.5036 - acc: 0.7335 - val_loss: 0.5045 - val_acc: 0.7126\n",
      "Epoch 106/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.5166 - acc: 0.7257 - val_loss: 0.5194 - val_acc: 0.7283\n",
      "Epoch 107/2000\n",
      "514/514 [==============================] - 0s 285us/step - loss: 0.5015 - acc: 0.7451 - val_loss: 0.4993 - val_acc: 0.7283\n",
      "Epoch 108/2000\n",
      "514/514 [==============================] - 0s 179us/step - loss: 0.4977 - acc: 0.7490 - val_loss: 0.5027 - val_acc: 0.7677\n",
      "Epoch 109/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.5346 - acc: 0.7451 - val_loss: 0.5771 - val_acc: 0.6772\n",
      "Epoch 110/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.5532 - acc: 0.7315 - val_loss: 0.5166 - val_acc: 0.7087\n",
      "Epoch 111/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.6030 - acc: 0.6926 - val_loss: 0.5169 - val_acc: 0.7677\n",
      "Epoch 112/2000\n",
      "514/514 [==============================] - 0s 359us/step - loss: 0.5377 - acc: 0.7082 - val_loss: 0.5044 - val_acc: 0.7598\n",
      "Epoch 113/2000\n",
      "514/514 [==============================] - 0s 352us/step - loss: 0.5060 - acc: 0.7412 - val_loss: 0.4992 - val_acc: 0.7205\n",
      "Epoch 114/2000\n",
      "514/514 [==============================] - 0s 148us/step - loss: 0.5485 - acc: 0.7140 - val_loss: 0.5046 - val_acc: 0.7205\n",
      "Epoch 115/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.5031 - acc: 0.7354 - val_loss: 0.4988 - val_acc: 0.7677\n",
      "Epoch 116/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.5205 - acc: 0.7490 - val_loss: 0.5068 - val_acc: 0.7677\n",
      "Epoch 117/2000\n",
      "514/514 [==============================] - 0s 171us/step - loss: 0.4989 - acc: 0.7588 - val_loss: 0.5192 - val_acc: 0.7598\n",
      "Epoch 118/2000\n",
      "514/514 [==============================] - 0s 267us/step - loss: 0.5256 - acc: 0.7315 - val_loss: 0.5100 - val_acc: 0.7283\n",
      "Epoch 119/2000\n",
      "514/514 [==============================] - 0s 294us/step - loss: 0.5144 - acc: 0.7607 - val_loss: 0.4973 - val_acc: 0.7441\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Epoch 120/2000\n",
      "514/514 [==============================] - 0s 144us/step - loss: 0.4985 - acc: 0.7704 - val_loss: 0.4981 - val_acc: 0.7717\n",
      "Epoch 121/2000\n",
      "514/514 [==============================] - 0s 82us/step - loss: 0.4999 - acc: 0.7665 - val_loss: 0.6166 - val_acc: 0.6969\n",
      "Epoch 122/2000\n",
      "514/514 [==============================] - 0s 150us/step - loss: 0.5447 - acc: 0.7432 - val_loss: 0.5063 - val_acc: 0.7323\n",
      "Epoch 123/2000\n",
      "514/514 [==============================] - 0s 328us/step - loss: 0.5515 - acc: 0.7374 - val_loss: 0.4967 - val_acc: 0.7677\n",
      "Epoch 124/2000\n",
      "514/514 [==============================] - 0s 165us/step - loss: 0.5532 - acc: 0.7218 - val_loss: 0.4899 - val_acc: 0.7756\n",
      "Epoch 125/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.5042 - acc: 0.7354 - val_loss: 0.4888 - val_acc: 0.7402\n",
      "Epoch 126/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4900 - acc: 0.7626 - val_loss: 0.4878 - val_acc: 0.7402\n",
      "Epoch 127/2000\n",
      "514/514 [==============================] - 0s 90us/step - loss: 0.5090 - acc: 0.7510 - val_loss: 0.5928 - val_acc: 0.6929\n",
      "Epoch 128/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.6520 - acc: 0.6537 - val_loss: 0.5500 - val_acc: 0.6693\n",
      "Epoch 129/2000\n",
      "514/514 [==============================] - 0s 89us/step - loss: 0.5198 - acc: 0.7160 - val_loss: 0.4978 - val_acc: 0.7362\n",
      "Epoch 130/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4957 - acc: 0.7549 - val_loss: 0.5117 - val_acc: 0.7283\n",
      "Epoch 131/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.5306 - acc: 0.7315 - val_loss: 0.6108 - val_acc: 0.6535\n",
      "Epoch 132/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.5458 - acc: 0.7276 - val_loss: 0.5413 - val_acc: 0.7598\n",
      "Epoch 133/2000\n",
      "514/514 [==============================] - 0s 90us/step - loss: 0.5172 - acc: 0.7607 - val_loss: 0.5113 - val_acc: 0.7520\n",
      "Epoch 134/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.5205 - acc: 0.7335 - val_loss: 0.5030 - val_acc: 0.7638\n",
      "Epoch 135/2000\n",
      "514/514 [==============================] - 0s 88us/step - loss: 0.4990 - acc: 0.7626 - val_loss: 0.4936 - val_acc: 0.7441\n",
      "Epoch 136/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4952 - acc: 0.7607 - val_loss: 0.4984 - val_acc: 0.7362\n",
      "Epoch 137/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4898 - acc: 0.7743 - val_loss: 0.4861 - val_acc: 0.7717\n",
      "Epoch 138/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.5056 - acc: 0.7374 - val_loss: 0.4869 - val_acc: 0.7835\n",
      "Epoch 139/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4908 - acc: 0.7665 - val_loss: 0.5165 - val_acc: 0.7205\n",
      "Epoch 140/2000\n",
      "514/514 [==============================] - 0s 220us/step - loss: 0.5043 - acc: 0.7646 - val_loss: 0.4905 - val_acc: 0.7362\n",
      "Epoch 141/2000\n",
      "514/514 [==============================] - 0s 172us/step - loss: 0.5283 - acc: 0.7121 - val_loss: 0.4941 - val_acc: 0.7520\n",
      "Epoch 142/2000\n",
      "514/514 [==============================] - 0s 161us/step - loss: 0.4900 - acc: 0.7510 - val_loss: 0.5452 - val_acc: 0.7205\n",
      "Epoch 143/2000\n",
      "514/514 [==============================] - 0s 189us/step - loss: 0.5257 - acc: 0.7354 - val_loss: 0.5196 - val_acc: 0.7205\n",
      "Epoch 144/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4972 - acc: 0.7510 - val_loss: 0.4862 - val_acc: 0.7441\n",
      "Epoch 145/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4900 - acc: 0.7549 - val_loss: 0.4821 - val_acc: 0.7677\n",
      "Epoch 146/2000\n",
      "514/514 [==============================] - 0s 90us/step - loss: 0.4868 - acc: 0.7432 - val_loss: 0.4940 - val_acc: 0.7480\n",
      "Epoch 147/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4871 - acc: 0.7607 - val_loss: 0.4817 - val_acc: 0.7677\n",
      "Epoch 148/2000\n",
      "514/514 [==============================] - 0s 87us/step - loss: 0.4926 - acc: 0.7588 - val_loss: 0.4898 - val_acc: 0.7717\n",
      "Epoch 149/2000\n",
      "514/514 [==============================] - 0s 180us/step - loss: 0.4877 - acc: 0.7568 - val_loss: 0.4903 - val_acc: 0.7441\n",
      "Epoch 150/2000\n",
      "514/514 [==============================] - 0s 142us/step - loss: 0.4941 - acc: 0.7549 - val_loss: 0.5103 - val_acc: 0.7283\n",
      "Epoch 151/2000\n",
      "514/514 [==============================] - 0s 196us/step - loss: 0.5224 - acc: 0.7335 - val_loss: 0.4861 - val_acc: 0.7756\n",
      "Epoch 152/2000\n",
      "514/514 [==============================] - 0s 142us/step - loss: 0.5246 - acc: 0.7062 - val_loss: 0.5000 - val_acc: 0.7283\n",
      "Epoch 153/2000\n",
      "514/514 [==============================] - 0s 194us/step - loss: 0.4910 - acc: 0.7432 - val_loss: 0.4838 - val_acc: 0.7402\n",
      "Epoch 154/2000\n",
      "514/514 [==============================] - 0s 173us/step - loss: 0.4862 - acc: 0.7665 - val_loss: 0.5251 - val_acc: 0.7323\n",
      "Epoch 155/2000\n",
      "514/514 [==============================] - 0s 157us/step - loss: 0.5070 - acc: 0.7529 - val_loss: 0.4853 - val_acc: 0.7756\n",
      "Epoch 156/2000\n",
      "514/514 [==============================] - 0s 160us/step - loss: 0.4950 - acc: 0.7568 - val_loss: 0.4800 - val_acc: 0.7795\n",
      "Epoch 157/2000\n",
      "514/514 [==============================] - 0s 192us/step - loss: 0.5246 - acc: 0.7354 - val_loss: 0.4982 - val_acc: 0.7362\n",
      "Epoch 158/2000\n",
      "514/514 [==============================] - 0s 169us/step - loss: 0.6402 - acc: 0.6362 - val_loss: 0.5867 - val_acc: 0.6654\n",
      "Epoch 159/2000\n",
      "514/514 [==============================] - 0s 206us/step - loss: 0.5784 - acc: 0.7160 - val_loss: 0.5112 - val_acc: 0.7559\n",
      "Epoch 160/2000\n",
      "514/514 [==============================] - 0s 149us/step - loss: 0.5338 - acc: 0.7237 - val_loss: 0.5289 - val_acc: 0.7323\n",
      "Epoch 161/2000\n",
      "514/514 [==============================] - 0s 220us/step - loss: 0.5375 - acc: 0.7529 - val_loss: 0.5147 - val_acc: 0.7205\n",
      "Epoch 162/2000\n",
      "514/514 [==============================] - 0s 143us/step - loss: 0.5129 - acc: 0.7471 - val_loss: 0.4891 - val_acc: 0.7756\n",
      "Epoch 163/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4854 - acc: 0.7588 - val_loss: 0.5041 - val_acc: 0.7283\n",
      "Epoch 164/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4931 - acc: 0.7626 - val_loss: 0.4801 - val_acc: 0.7677\n",
      "Epoch 165/2000\n",
      "514/514 [==============================] - 0s 176us/step - loss: 0.4898 - acc: 0.7607 - val_loss: 0.4797 - val_acc: 0.7795\n",
      "Epoch 166/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4795 - acc: 0.7588 - val_loss: 0.5140 - val_acc: 0.7559\n",
      "Epoch 167/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.5013 - acc: 0.7490 - val_loss: 0.4786 - val_acc: 0.7756\n",
      "Epoch 168/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4798 - acc: 0.7607 - val_loss: 0.4783 - val_acc: 0.7756\n",
      "Epoch 169/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4743 - acc: 0.7665 - val_loss: 0.4884 - val_acc: 0.7402\n",
      "Epoch 170/2000\n",
      "514/514 [==============================] - 0s 142us/step - loss: 0.4813 - acc: 0.7665 - val_loss: 0.4762 - val_acc: 0.7638\n",
      "Epoch 171/2000\n",
      "514/514 [==============================] - 0s 328us/step - loss: 0.4925 - acc: 0.7451 - val_loss: 0.4873 - val_acc: 0.7362\n",
      "Epoch 172/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.4766 - acc: 0.7802 - val_loss: 0.4779 - val_acc: 0.7559\n",
      "Epoch 173/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.5218 - acc: 0.7432 - val_loss: 0.4763 - val_acc: 0.7480\n",
      "Epoch 174/2000\n",
      "514/514 [==============================] - 0s 196us/step - loss: 0.4782 - acc: 0.7860 - val_loss: 0.4834 - val_acc: 0.7441\n",
      "Epoch 175/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.4797 - acc: 0.7704 - val_loss: 0.4908 - val_acc: 0.7677\n",
      "Epoch 176/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4892 - acc: 0.7607 - val_loss: 0.4752 - val_acc: 0.7992\n",
      "Epoch 177/2000\n",
      "514/514 [==============================] - 0s 189us/step - loss: 0.4789 - acc: 0.7646 - val_loss: 0.4946 - val_acc: 0.7283\n",
      "Epoch 178/2000\n",
      "514/514 [==============================] - 0s 206us/step - loss: 0.4778 - acc: 0.7568 - val_loss: 0.5171 - val_acc: 0.7205\n",
      "Epoch 179/2000\n",
      "514/514 [==============================] - 0s 145us/step - loss: 0.5602 - acc: 0.7198 - val_loss: 0.5045 - val_acc: 0.7402\n",
      "Epoch 180/2000\n",
      "514/514 [==============================] - 0s 149us/step - loss: 0.4883 - acc: 0.7490 - val_loss: 0.4891 - val_acc: 0.7913\n",
      "Epoch 181/2000\n",
      "514/514 [==============================] - 0s 77us/step - loss: 0.4810 - acc: 0.7626 - val_loss: 0.4963 - val_acc: 0.7520\n",
      "Epoch 182/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4878 - acc: 0.7490 - val_loss: 0.4758 - val_acc: 0.7717\n",
      "Epoch 183/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4698 - acc: 0.7840 - val_loss: 0.4769 - val_acc: 0.7559\n",
      "Epoch 184/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4705 - acc: 0.7763 - val_loss: 0.4802 - val_acc: 0.7362\n",
      "Epoch 185/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4982 - acc: 0.7607 - val_loss: 0.4916 - val_acc: 0.7402\n",
      "Epoch 186/2000\n",
      "514/514 [==============================] - 0s 83us/step - loss: 0.4698 - acc: 0.7840 - val_loss: 0.4782 - val_acc: 0.7480\n",
      "Epoch 187/2000\n",
      "514/514 [==============================] - 0s 83us/step - loss: 0.4824 - acc: 0.7646 - val_loss: 0.4752 - val_acc: 0.7520\n",
      "Epoch 188/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.5008 - acc: 0.7588 - val_loss: 0.5107 - val_acc: 0.7283\n",
      "Epoch 189/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4896 - acc: 0.7588 - val_loss: 0.4760 - val_acc: 0.8071\n",
      "Epoch 190/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4837 - acc: 0.7743 - val_loss: 0.4874 - val_acc: 0.7362\n",
      "Epoch 191/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4787 - acc: 0.7704 - val_loss: 0.5195 - val_acc: 0.7126\n",
      "Epoch 192/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.5082 - acc: 0.7626 - val_loss: 0.5904 - val_acc: 0.6614\n",
      "Epoch 193/2000\n",
      "514/514 [==============================] - 0s 221us/step - loss: 0.5036 - acc: 0.7451 - val_loss: 0.4715 - val_acc: 0.7874\n",
      "Epoch 194/2000\n",
      "514/514 [==============================] - 0s 171us/step - loss: 0.4691 - acc: 0.7763 - val_loss: 0.4742 - val_acc: 0.7598\n",
      "Epoch 195/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4709 - acc: 0.7763 - val_loss: 0.4825 - val_acc: 0.7441\n",
      "Epoch 196/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4722 - acc: 0.7743 - val_loss: 0.4733 - val_acc: 0.7520\n",
      "Epoch 197/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4732 - acc: 0.7685 - val_loss: 0.5211 - val_acc: 0.7126\n",
      "Epoch 198/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4834 - acc: 0.7782 - val_loss: 0.5085 - val_acc: 0.7205\n",
      "Epoch 199/2000\n",
      "514/514 [==============================] - 0s 91us/step - loss: 0.4994 - acc: 0.7471 - val_loss: 0.4713 - val_acc: 0.7953\n",
      "Epoch 200/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4673 - acc: 0.7821 - val_loss: 0.4706 - val_acc: 0.7874\n",
      "Epoch 201/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4672 - acc: 0.7802 - val_loss: 0.4719 - val_acc: 0.7638\n",
      "Epoch 202/2000\n",
      "514/514 [==============================] - 0s 140us/step - loss: 0.4629 - acc: 0.7782 - val_loss: 0.4725 - val_acc: 0.7756\n",
      "Epoch 203/2000\n",
      "514/514 [==============================] - 0s 180us/step - loss: 0.4743 - acc: 0.7607 - val_loss: 0.5397 - val_acc: 0.7520\n",
      "Epoch 204/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.5070 - acc: 0.7704 - val_loss: 0.4965 - val_acc: 0.7480\n",
      "Epoch 205/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4811 - acc: 0.7510 - val_loss: 0.4718 - val_acc: 0.7913\n",
      "Epoch 206/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4711 - acc: 0.7763 - val_loss: 0.4743 - val_acc: 0.7717\n",
      "Epoch 207/2000\n",
      "514/514 [==============================] - 0s 166us/step - loss: 0.4683 - acc: 0.7763 - val_loss: 0.4730 - val_acc: 0.7480\n",
      "Epoch 208/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.5007 - acc: 0.7471 - val_loss: 0.4851 - val_acc: 0.7441\n",
      "Epoch 209/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4780 - acc: 0.7665 - val_loss: 0.4876 - val_acc: 0.7953\n",
      "Epoch 210/2000\n",
      "514/514 [==============================] - 0s 165us/step - loss: 0.4803 - acc: 0.7646 - val_loss: 0.4703 - val_acc: 0.8031\n",
      "Epoch 211/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4938 - acc: 0.7432 - val_loss: 0.4708 - val_acc: 0.7835\n",
      "Epoch 212/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4734 - acc: 0.7646 - val_loss: 0.4703 - val_acc: 0.7598\n",
      "Epoch 213/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.5072 - acc: 0.7471 - val_loss: 0.4904 - val_acc: 0.7480\n",
      "Epoch 214/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4711 - acc: 0.7529 - val_loss: 0.4758 - val_acc: 0.7992\n",
      "Epoch 215/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4668 - acc: 0.7665 - val_loss: 0.4807 - val_acc: 0.7441\n",
      "Epoch 216/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4601 - acc: 0.7918 - val_loss: 0.4760 - val_acc: 0.8031\n",
      "Epoch 217/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4741 - acc: 0.7704 - val_loss: 0.4800 - val_acc: 0.7913\n",
      "Epoch 218/2000\n",
      "514/514 [==============================] - 0s 169us/step - loss: 0.5085 - acc: 0.7685 - val_loss: 0.4822 - val_acc: 0.7559\n",
      "Epoch 219/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4713 - acc: 0.7685 - val_loss: 0.4730 - val_acc: 0.7520\n",
      "Epoch 220/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4648 - acc: 0.7899 - val_loss: 0.4756 - val_acc: 0.7480\n",
      "Epoch 221/2000\n",
      "514/514 [==============================] - 0s 170us/step - loss: 0.4673 - acc: 0.7704 - val_loss: 0.4728 - val_acc: 0.7677\n",
      "Epoch 222/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4636 - acc: 0.7802 - val_loss: 0.4707 - val_acc: 0.7638\n",
      "Epoch 223/2000\n",
      "514/514 [==============================] - 0s 180us/step - loss: 0.4599 - acc: 0.7918 - val_loss: 0.4968 - val_acc: 0.7283\n",
      "Epoch 224/2000\n",
      "514/514 [==============================] - 0s 190us/step - loss: 0.4882 - acc: 0.7490 - val_loss: 0.4743 - val_acc: 0.7520\n",
      "Epoch 225/2000\n",
      "514/514 [==============================] - 0s 181us/step - loss: 0.4692 - acc: 0.7665 - val_loss: 0.4735 - val_acc: 0.7598\n",
      "Epoch 226/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4685 - acc: 0.7899 - val_loss: 0.4905 - val_acc: 0.7362\n",
      "Epoch 227/2000\n",
      "514/514 [==============================] - 0s 139us/step - loss: 0.4707 - acc: 0.7743 - val_loss: 0.4689 - val_acc: 0.7638\n",
      "Epoch 228/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.4591 - acc: 0.7802 - val_loss: 0.4909 - val_acc: 0.7362\n",
      "Epoch 229/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4678 - acc: 0.7646 - val_loss: 0.5036 - val_acc: 0.7165\n",
      "Epoch 230/2000\n",
      "514/514 [==============================] - 0s 199us/step - loss: 0.4678 - acc: 0.7918 - val_loss: 0.5154 - val_acc: 0.6850\n",
      "Epoch 231/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.5215 - acc: 0.7218 - val_loss: 0.4646 - val_acc: 0.8189\n",
      "Epoch 232/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4676 - acc: 0.7840 - val_loss: 0.4827 - val_acc: 0.7441\n",
      "Epoch 233/2000\n",
      "514/514 [==============================] - 0s 194us/step - loss: 0.4614 - acc: 0.7724 - val_loss: 0.4861 - val_acc: 0.7520\n",
      "Epoch 234/2000\n",
      "514/514 [==============================] - 0s 161us/step - loss: 0.4748 - acc: 0.7724 - val_loss: 0.4854 - val_acc: 0.7402\n",
      "Epoch 235/2000\n",
      "514/514 [==============================] - 0s 179us/step - loss: 0.4659 - acc: 0.7763 - val_loss: 0.4962 - val_acc: 0.7598\n",
      "Epoch 236/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4819 - acc: 0.7685 - val_loss: 0.4652 - val_acc: 0.8071\n",
      "Epoch 237/2000\n",
      "514/514 [==============================] - 0s 147us/step - loss: 0.4601 - acc: 0.7918 - val_loss: 0.4757 - val_acc: 0.7520\n",
      "Epoch 238/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 104us/step - loss: 0.4707 - acc: 0.7607 - val_loss: 0.4838 - val_acc: 0.7480\n",
      "Epoch 239/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.4737 - acc: 0.7840 - val_loss: 0.4952 - val_acc: 0.7402\n",
      "Epoch 240/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4701 - acc: 0.7860 - val_loss: 0.4727 - val_acc: 0.8031\n",
      "Epoch 241/2000\n",
      "514/514 [==============================] - 0s 91us/step - loss: 0.4996 - acc: 0.7685 - val_loss: 0.4636 - val_acc: 0.8031\n",
      "Epoch 242/2000\n",
      "514/514 [==============================] - 0s 85us/step - loss: 0.4571 - acc: 0.7860 - val_loss: 0.4681 - val_acc: 0.7835\n",
      "Epoch 243/2000\n",
      "514/514 [==============================] - 0s 85us/step - loss: 0.4651 - acc: 0.7763 - val_loss: 0.4677 - val_acc: 0.7559\n",
      "Epoch 244/2000\n",
      "514/514 [==============================] - 0s 89us/step - loss: 0.4797 - acc: 0.7588 - val_loss: 0.4694 - val_acc: 0.7638\n",
      "Epoch 245/2000\n",
      "514/514 [==============================] - 0s 85us/step - loss: 0.4590 - acc: 0.7840 - val_loss: 0.4746 - val_acc: 0.7520\n",
      "Epoch 246/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4621 - acc: 0.7646 - val_loss: 0.4700 - val_acc: 0.7520\n",
      "Epoch 247/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4615 - acc: 0.7607 - val_loss: 0.4728 - val_acc: 0.7913\n",
      "Epoch 248/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4613 - acc: 0.7860 - val_loss: 0.4649 - val_acc: 0.7992\n",
      "Epoch 249/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4836 - acc: 0.7743 - val_loss: 0.4692 - val_acc: 0.7638\n",
      "Epoch 250/2000\n",
      "514/514 [==============================] - 0s 148us/step - loss: 0.4747 - acc: 0.7646 - val_loss: 0.5432 - val_acc: 0.7008\n",
      "Epoch 251/2000\n",
      "514/514 [==============================] - 0s 142us/step - loss: 0.4923 - acc: 0.7626 - val_loss: 0.5007 - val_acc: 0.7323\n",
      "Epoch 252/2000\n",
      "514/514 [==============================] - 0s 167us/step - loss: 0.4730 - acc: 0.7782 - val_loss: 0.5244 - val_acc: 0.7087\n",
      "Epoch 253/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4817 - acc: 0.7510 - val_loss: 0.4690 - val_acc: 0.7953\n",
      "Epoch 254/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4715 - acc: 0.7743 - val_loss: 0.4740 - val_acc: 0.7913\n",
      "Epoch 255/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4588 - acc: 0.7763 - val_loss: 0.4699 - val_acc: 0.7559\n",
      "Epoch 256/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4601 - acc: 0.7821 - val_loss: 0.4754 - val_acc: 0.7520\n",
      "Epoch 257/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4544 - acc: 0.7821 - val_loss: 0.4662 - val_acc: 0.8071\n",
      "Epoch 258/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4640 - acc: 0.7743 - val_loss: 0.5069 - val_acc: 0.7087\n",
      "Epoch 259/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4601 - acc: 0.7607 - val_loss: 0.4654 - val_acc: 0.7717\n",
      "Epoch 260/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4581 - acc: 0.7685 - val_loss: 0.4694 - val_acc: 0.8110\n",
      "Epoch 261/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4657 - acc: 0.7860 - val_loss: 0.4650 - val_acc: 0.7874\n",
      "Epoch 262/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4645 - acc: 0.7840 - val_loss: 0.4688 - val_acc: 0.8071\n",
      "Epoch 263/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4632 - acc: 0.7860 - val_loss: 0.4761 - val_acc: 0.7598\n",
      "Epoch 264/2000\n",
      "514/514 [==============================] - 0s 192us/step - loss: 0.4773 - acc: 0.7607 - val_loss: 0.5496 - val_acc: 0.6811\n",
      "Epoch 265/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4713 - acc: 0.7607 - val_loss: 0.4887 - val_acc: 0.7480\n",
      "Epoch 266/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4626 - acc: 0.7607 - val_loss: 0.4696 - val_acc: 0.7677\n",
      "Epoch 267/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4598 - acc: 0.7646 - val_loss: 0.4847 - val_acc: 0.7559\n",
      "Epoch 268/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4585 - acc: 0.7840 - val_loss: 0.4654 - val_acc: 0.8071\n",
      "Epoch 269/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4741 - acc: 0.7704 - val_loss: 0.4656 - val_acc: 0.7559\n",
      "Epoch 270/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4633 - acc: 0.7782 - val_loss: 0.4703 - val_acc: 0.7717\n",
      "Epoch 271/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4726 - acc: 0.7743 - val_loss: 0.4691 - val_acc: 0.7953\n",
      "Epoch 272/2000\n",
      "514/514 [==============================] - 0s 155us/step - loss: 0.4756 - acc: 0.7763 - val_loss: 0.4639 - val_acc: 0.7953\n",
      "Epoch 273/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4528 - acc: 0.7860 - val_loss: 0.4704 - val_acc: 0.7559\n",
      "Epoch 274/2000\n",
      "514/514 [==============================] - 0s 190us/step - loss: 0.4646 - acc: 0.7763 - val_loss: 0.4675 - val_acc: 0.7756\n",
      "Epoch 275/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4709 - acc: 0.7704 - val_loss: 0.4633 - val_acc: 0.8110\n",
      "Epoch 276/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4971 - acc: 0.7588 - val_loss: 0.4927 - val_acc: 0.7677\n",
      "Epoch 277/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4588 - acc: 0.7743 - val_loss: 0.4712 - val_acc: 0.8071\n",
      "Epoch 278/2000\n",
      "514/514 [==============================] - 0s 169us/step - loss: 0.4600 - acc: 0.7763 - val_loss: 0.4631 - val_acc: 0.7992\n",
      "Epoch 279/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.4569 - acc: 0.7840 - val_loss: 0.4715 - val_acc: 0.7717\n",
      "Epoch 280/2000\n",
      "514/514 [==============================] - 0s 208us/step - loss: 0.4566 - acc: 0.7665 - val_loss: 0.4648 - val_acc: 0.7874\n",
      "Epoch 281/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4524 - acc: 0.7802 - val_loss: 0.4943 - val_acc: 0.7795\n",
      "Epoch 282/2000\n",
      "514/514 [==============================] - 0s 140us/step - loss: 0.4961 - acc: 0.7568 - val_loss: 0.4603 - val_acc: 0.8150\n",
      "Epoch 283/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4579 - acc: 0.7743 - val_loss: 0.4748 - val_acc: 0.7598\n",
      "Epoch 284/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4789 - acc: 0.7743 - val_loss: 0.4920 - val_acc: 0.7362\n",
      "Epoch 285/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4529 - acc: 0.7918 - val_loss: 0.4634 - val_acc: 0.7874\n",
      "Epoch 286/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4517 - acc: 0.7724 - val_loss: 0.4658 - val_acc: 0.7598\n",
      "Epoch 287/2000\n",
      "514/514 [==============================] - 0s 152us/step - loss: 0.4556 - acc: 0.7782 - val_loss: 0.4900 - val_acc: 0.7402\n",
      "Epoch 288/2000\n",
      "514/514 [==============================] - 0s 139us/step - loss: 0.4632 - acc: 0.7763 - val_loss: 0.4915 - val_acc: 0.7205\n",
      "Epoch 289/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4684 - acc: 0.7704 - val_loss: 0.4783 - val_acc: 0.7598\n",
      "Epoch 290/2000\n",
      "514/514 [==============================] - 0s 174us/step - loss: 0.4582 - acc: 0.7782 - val_loss: 0.4771 - val_acc: 0.8071\n",
      "Epoch 291/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4541 - acc: 0.7899 - val_loss: 0.4792 - val_acc: 0.7638\n",
      "Epoch 292/2000\n",
      "514/514 [==============================] - 0s 158us/step - loss: 0.4595 - acc: 0.7665 - val_loss: 0.4804 - val_acc: 0.7559\n",
      "Epoch 293/2000\n",
      "514/514 [==============================] - 0s 186us/step - loss: 0.4540 - acc: 0.7743 - val_loss: 0.4733 - val_acc: 0.7953\n",
      "Epoch 294/2000\n",
      "514/514 [==============================] - 0s 199us/step - loss: 0.4740 - acc: 0.7763 - val_loss: 0.4608 - val_acc: 0.8071\n",
      "Epoch 295/2000\n",
      "514/514 [==============================] - 0s 183us/step - loss: 0.4528 - acc: 0.7724 - val_loss: 0.4630 - val_acc: 0.7874\n",
      "Epoch 296/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4531 - acc: 0.7802 - val_loss: 0.4610 - val_acc: 0.7992\n",
      "Epoch 297/2000\n",
      "514/514 [==============================] - 0s 176us/step - loss: 0.4644 - acc: 0.7879 - val_loss: 0.4932 - val_acc: 0.7205\n",
      "Epoch 298/2000\n",
      "514/514 [==============================] - 0s 92us/step - loss: 0.4499 - acc: 0.7743 - val_loss: 0.4664 - val_acc: 0.7638\n",
      "Epoch 299/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4524 - acc: 0.7821 - val_loss: 0.4626 - val_acc: 0.7992\n",
      "Epoch 300/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4521 - acc: 0.7899 - val_loss: 0.4648 - val_acc: 0.7992\n",
      "Epoch 301/2000\n",
      "514/514 [==============================] - 0s 92us/step - loss: 0.4509 - acc: 0.7782 - val_loss: 0.4834 - val_acc: 0.7559\n",
      "Epoch 302/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4548 - acc: 0.7899 - val_loss: 0.4631 - val_acc: 0.7835\n",
      "Epoch 303/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4542 - acc: 0.7802 - val_loss: 0.4671 - val_acc: 0.7992\n",
      "Epoch 304/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4549 - acc: 0.7977 - val_loss: 0.4824 - val_acc: 0.7638\n",
      "Epoch 305/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4542 - acc: 0.7957 - val_loss: 0.4722 - val_acc: 0.7677\n",
      "Epoch 306/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4518 - acc: 0.7840 - val_loss: 0.4641 - val_acc: 0.7992\n",
      "Epoch 307/2000\n",
      "514/514 [==============================] - 0s 89us/step - loss: 0.4593 - acc: 0.7821 - val_loss: 0.4694 - val_acc: 0.7953\n",
      "Epoch 308/2000\n",
      "514/514 [==============================] - 0s 89us/step - loss: 0.4617 - acc: 0.7821 - val_loss: 0.4838 - val_acc: 0.7559\n",
      "Epoch 309/2000\n",
      "514/514 [==============================] - 0s 140us/step - loss: 0.5291 - acc: 0.7296 - val_loss: 0.4699 - val_acc: 0.7874\n",
      "Epoch 310/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4835 - acc: 0.7529 - val_loss: 0.4712 - val_acc: 0.7874\n",
      "Epoch 311/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4588 - acc: 0.7860 - val_loss: 0.4732 - val_acc: 0.8031\n",
      "Epoch 312/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4723 - acc: 0.7724 - val_loss: 0.4610 - val_acc: 0.8150\n",
      "Epoch 313/2000\n",
      "514/514 [==============================] - 0s 178us/step - loss: 0.4844 - acc: 0.7471 - val_loss: 0.4779 - val_acc: 0.7992\n",
      "Epoch 314/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4878 - acc: 0.7568 - val_loss: 0.5181 - val_acc: 0.7008\n",
      "Epoch 315/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4682 - acc: 0.7588 - val_loss: 0.5165 - val_acc: 0.7047\n",
      "Epoch 316/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4582 - acc: 0.7665 - val_loss: 0.4669 - val_acc: 0.8031\n",
      "Epoch 317/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4511 - acc: 0.7802 - val_loss: 0.4675 - val_acc: 0.7677\n",
      "Epoch 318/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4524 - acc: 0.7802 - val_loss: 0.4650 - val_acc: 0.7756\n",
      "Epoch 319/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4502 - acc: 0.7879 - val_loss: 0.4670 - val_acc: 0.7992\n",
      "Epoch 320/2000\n",
      "514/514 [==============================] - 0s 177us/step - loss: 0.4491 - acc: 0.7840 - val_loss: 0.4700 - val_acc: 0.8031\n",
      "Epoch 321/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4564 - acc: 0.7743 - val_loss: 0.4656 - val_acc: 0.7992\n",
      "Epoch 322/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4538 - acc: 0.7782 - val_loss: 0.4708 - val_acc: 0.7756\n",
      "Epoch 323/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4629 - acc: 0.7763 - val_loss: 0.5565 - val_acc: 0.6811\n",
      "Epoch 324/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.5193 - acc: 0.7451 - val_loss: 0.4687 - val_acc: 0.7913\n",
      "Epoch 325/2000\n",
      "514/514 [==============================] - 0s 191us/step - loss: 0.4648 - acc: 0.7763 - val_loss: 0.4685 - val_acc: 0.7638\n",
      "Epoch 326/2000\n",
      "514/514 [==============================] - 0s 189us/step - loss: 0.4754 - acc: 0.7724 - val_loss: 0.4643 - val_acc: 0.7992\n",
      "Epoch 327/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4587 - acc: 0.7938 - val_loss: 0.4714 - val_acc: 0.7638\n",
      "Epoch 328/2000\n",
      "514/514 [==============================] - 0s 163us/step - loss: 0.4499 - acc: 0.7802 - val_loss: 0.4630 - val_acc: 0.7913\n",
      "Epoch 329/2000\n",
      "514/514 [==============================] - 0s 161us/step - loss: 0.4490 - acc: 0.7802 - val_loss: 0.4759 - val_acc: 0.7638\n",
      "Epoch 330/2000\n",
      "514/514 [==============================] - 0s 226us/step - loss: 0.4538 - acc: 0.7996 - val_loss: 0.4709 - val_acc: 0.7677\n",
      "Epoch 331/2000\n",
      "514/514 [==============================] - 0s 192us/step - loss: 0.4525 - acc: 0.7782 - val_loss: 0.4631 - val_acc: 0.7992\n",
      "Epoch 332/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4753 - acc: 0.7568 - val_loss: 0.4662 - val_acc: 0.7717\n",
      "Epoch 333/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4582 - acc: 0.7743 - val_loss: 0.4969 - val_acc: 0.7126\n",
      "Epoch 334/2000\n",
      "514/514 [==============================] - 0s 159us/step - loss: 0.4694 - acc: 0.7588 - val_loss: 0.4797 - val_acc: 0.7638\n",
      "Epoch 335/2000\n",
      "514/514 [==============================] - 0s 204us/step - loss: 0.4525 - acc: 0.7743 - val_loss: 0.4928 - val_acc: 0.7362\n",
      "Epoch 336/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4508 - acc: 0.7782 - val_loss: 0.4690 - val_acc: 0.7717\n",
      "Epoch 337/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4515 - acc: 0.7821 - val_loss: 0.4852 - val_acc: 0.7520\n",
      "Epoch 338/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4608 - acc: 0.7626 - val_loss: 0.4648 - val_acc: 0.7992\n",
      "Epoch 339/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4552 - acc: 0.7724 - val_loss: 0.4675 - val_acc: 0.7953\n",
      "Epoch 340/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4796 - acc: 0.7588 - val_loss: 0.4614 - val_acc: 0.8110\n",
      "Epoch 341/2000\n",
      "514/514 [==============================] - 0s 205us/step - loss: 0.4750 - acc: 0.7626 - val_loss: 0.5097 - val_acc: 0.7047\n",
      "Epoch 342/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4506 - acc: 0.7860 - val_loss: 0.4700 - val_acc: 0.7677\n",
      "Epoch 343/2000\n",
      "514/514 [==============================] - 0s 157us/step - loss: 0.4637 - acc: 0.7879 - val_loss: 0.4633 - val_acc: 0.7992\n",
      "Epoch 344/2000\n",
      "514/514 [==============================] - 0s 203us/step - loss: 0.4501 - acc: 0.7743 - val_loss: 0.4708 - val_acc: 0.8031\n",
      "Epoch 345/2000\n",
      "514/514 [==============================] - 0s 349us/step - loss: 0.4516 - acc: 0.7782 - val_loss: 0.5105 - val_acc: 0.7008\n",
      "Epoch 346/2000\n",
      "514/514 [==============================] - 0s 257us/step - loss: 0.4659 - acc: 0.7802 - val_loss: 0.4738 - val_acc: 0.7598\n",
      "Epoch 347/2000\n",
      "514/514 [==============================] - 0s 269us/step - loss: 0.4558 - acc: 0.7802 - val_loss: 0.4758 - val_acc: 0.7874\n",
      "Epoch 348/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4556 - acc: 0.7782 - val_loss: 0.4704 - val_acc: 0.7717\n",
      "Epoch 349/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4726 - acc: 0.7763 - val_loss: 0.4971 - val_acc: 0.7205\n",
      "Epoch 350/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4499 - acc: 0.7626 - val_loss: 0.4642 - val_acc: 0.7913\n",
      "Epoch 351/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4566 - acc: 0.7743 - val_loss: 0.4642 - val_acc: 0.7953\n",
      "Epoch 352/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4570 - acc: 0.7860 - val_loss: 0.4673 - val_acc: 0.7835\n",
      "Epoch 353/2000\n",
      "514/514 [==============================] - 0s 169us/step - loss: 0.4488 - acc: 0.7802 - val_loss: 0.5030 - val_acc: 0.7126\n",
      "Epoch 354/2000\n",
      "514/514 [==============================] - 0s 151us/step - loss: 0.4664 - acc: 0.7782 - val_loss: 0.4735 - val_acc: 0.7520\n",
      "Epoch 355/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4490 - acc: 0.7899 - val_loss: 0.4602 - val_acc: 0.7992\n",
      "Epoch 356/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 161us/step - loss: 0.4502 - acc: 0.7860 - val_loss: 0.4623 - val_acc: 0.7874\n",
      "Epoch 357/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4980 - acc: 0.7588 - val_loss: 0.4996 - val_acc: 0.7362\n",
      "Epoch 358/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4556 - acc: 0.7938 - val_loss: 0.4756 - val_acc: 0.7677\n",
      "Epoch 359/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4515 - acc: 0.7763 - val_loss: 0.5072 - val_acc: 0.7008\n",
      "Epoch 360/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4765 - acc: 0.7685 - val_loss: 0.4732 - val_acc: 0.7638\n",
      "Epoch 361/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4575 - acc: 0.7860 - val_loss: 0.4640 - val_acc: 0.7913\n",
      "Epoch 362/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4557 - acc: 0.7840 - val_loss: 0.4789 - val_acc: 0.7717\n",
      "Epoch 363/2000\n",
      "514/514 [==============================] - 0s 188us/step - loss: 0.4494 - acc: 0.7802 - val_loss: 0.4726 - val_acc: 0.7598\n",
      "Epoch 364/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4920 - acc: 0.7393 - val_loss: 0.4751 - val_acc: 0.7717\n",
      "Epoch 365/2000\n",
      "514/514 [==============================] - 0s 90us/step - loss: 0.4590 - acc: 0.7763 - val_loss: 0.4626 - val_acc: 0.8071\n",
      "Epoch 366/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4719 - acc: 0.7665 - val_loss: 0.4685 - val_acc: 0.7598\n",
      "Epoch 367/2000\n",
      "514/514 [==============================] - 0s 92us/step - loss: 0.4507 - acc: 0.7802 - val_loss: 0.4787 - val_acc: 0.7953\n",
      "Epoch 368/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4527 - acc: 0.7782 - val_loss: 0.4775 - val_acc: 0.7677\n",
      "Epoch 369/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4486 - acc: 0.7821 - val_loss: 0.4741 - val_acc: 0.7717\n",
      "Epoch 370/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4500 - acc: 0.7879 - val_loss: 0.4769 - val_acc: 0.7677\n",
      "Epoch 371/2000\n",
      "514/514 [==============================] - 0s 147us/step - loss: 0.4659 - acc: 0.7879 - val_loss: 0.4701 - val_acc: 0.7677\n",
      "Epoch 372/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4949 - acc: 0.7646 - val_loss: 0.4835 - val_acc: 0.7913\n",
      "Epoch 373/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4553 - acc: 0.7802 - val_loss: 0.4980 - val_acc: 0.7205\n",
      "Epoch 374/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4678 - acc: 0.7588 - val_loss: 0.4776 - val_acc: 0.8071\n",
      "Epoch 375/2000\n",
      "514/514 [==============================] - 0s 91us/step - loss: 0.4630 - acc: 0.7549 - val_loss: 0.4636 - val_acc: 0.8031\n",
      "Epoch 376/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4856 - acc: 0.7471 - val_loss: 0.4773 - val_acc: 0.7756\n",
      "Epoch 377/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4587 - acc: 0.7724 - val_loss: 0.4748 - val_acc: 0.8110\n",
      "Epoch 378/2000\n",
      "514/514 [==============================] - 0s 167us/step - loss: 0.4709 - acc: 0.7743 - val_loss: 0.4672 - val_acc: 0.7874\n",
      "Epoch 379/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.4489 - acc: 0.7860 - val_loss: 0.4733 - val_acc: 0.7677\n",
      "Epoch 380/2000\n",
      "514/514 [==============================] - 0s 136us/step - loss: 0.4560 - acc: 0.7899 - val_loss: 0.4806 - val_acc: 0.7559\n",
      "Epoch 381/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4575 - acc: 0.7840 - val_loss: 0.4756 - val_acc: 0.7677\n",
      "Epoch 382/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4646 - acc: 0.7918 - val_loss: 0.4801 - val_acc: 0.7874\n",
      "Epoch 383/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4546 - acc: 0.7899 - val_loss: 0.4734 - val_acc: 0.7638\n",
      "Epoch 384/2000\n",
      "514/514 [==============================] - 0s 174us/step - loss: 0.4627 - acc: 0.7646 - val_loss: 0.4634 - val_acc: 0.7992\n",
      "Epoch 385/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4487 - acc: 0.7899 - val_loss: 0.4763 - val_acc: 0.7598\n",
      "Epoch 386/2000\n",
      "514/514 [==============================] - 0s 167us/step - loss: 0.4514 - acc: 0.7879 - val_loss: 0.4776 - val_acc: 0.7638\n",
      "Epoch 387/2000\n",
      "514/514 [==============================] - 0s 137us/step - loss: 0.4611 - acc: 0.7665 - val_loss: 0.4708 - val_acc: 0.7913\n",
      "Epoch 388/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4608 - acc: 0.7704 - val_loss: 0.4639 - val_acc: 0.7913\n",
      "Epoch 389/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.4502 - acc: 0.7782 - val_loss: 0.4661 - val_acc: 0.7992\n",
      "Epoch 390/2000\n",
      "514/514 [==============================] - 0s 139us/step - loss: 0.5080 - acc: 0.7588 - val_loss: 0.5674 - val_acc: 0.6732\n",
      "Epoch 391/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4838 - acc: 0.7607 - val_loss: 0.4681 - val_acc: 0.7913\n",
      "Epoch 392/2000\n",
      "514/514 [==============================] - 0s 181us/step - loss: 0.4521 - acc: 0.7899 - val_loss: 0.4705 - val_acc: 0.8031\n",
      "Epoch 393/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4548 - acc: 0.7821 - val_loss: 0.4691 - val_acc: 0.7835\n",
      "Epoch 394/2000\n",
      "514/514 [==============================] - 0s 180us/step - loss: 0.4478 - acc: 0.7840 - val_loss: 0.4839 - val_acc: 0.7953\n",
      "Epoch 395/2000\n",
      "514/514 [==============================] - 0s 149us/step - loss: 0.4862 - acc: 0.7626 - val_loss: 0.4632 - val_acc: 0.7992\n",
      "Epoch 396/2000\n",
      "514/514 [==============================] - 0s 154us/step - loss: 0.4753 - acc: 0.7646 - val_loss: 0.4619 - val_acc: 0.8031\n",
      "Epoch 397/2000\n",
      "514/514 [==============================] - 0s 197us/step - loss: 0.4780 - acc: 0.7510 - val_loss: 0.5236 - val_acc: 0.7126\n",
      "Epoch 398/2000\n",
      "514/514 [==============================] - 0s 177us/step - loss: 0.4786 - acc: 0.7646 - val_loss: 0.4670 - val_acc: 0.8031\n",
      "Epoch 399/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.4500 - acc: 0.7704 - val_loss: 0.4674 - val_acc: 0.7992\n",
      "Epoch 400/2000\n",
      "514/514 [==============================] - 0s 137us/step - loss: 0.4542 - acc: 0.7704 - val_loss: 0.4683 - val_acc: 0.7913\n",
      "Epoch 401/2000\n",
      "514/514 [==============================] - 0s 143us/step - loss: 0.4773 - acc: 0.7782 - val_loss: 0.4656 - val_acc: 0.7953\n",
      "Epoch 402/2000\n",
      "514/514 [==============================] - 0s 190us/step - loss: 0.4528 - acc: 0.7879 - val_loss: 0.5044 - val_acc: 0.7047\n",
      "Epoch 403/2000\n",
      "514/514 [==============================] - 0s 190us/step - loss: 0.4658 - acc: 0.7685 - val_loss: 0.4657 - val_acc: 0.7874\n",
      "Epoch 404/2000\n",
      "514/514 [==============================] - 0s 165us/step - loss: 0.4436 - acc: 0.7840 - val_loss: 0.4650 - val_acc: 0.7992\n",
      "Epoch 405/2000\n",
      "514/514 [==============================] - 0s 178us/step - loss: 0.4519 - acc: 0.7763 - val_loss: 0.4645 - val_acc: 0.7913\n",
      "Epoch 406/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4505 - acc: 0.7821 - val_loss: 0.4647 - val_acc: 0.7992\n",
      "Epoch 407/2000\n",
      "514/514 [==============================] - 0s 156us/step - loss: 0.4483 - acc: 0.7860 - val_loss: 0.4669 - val_acc: 0.7795\n",
      "Epoch 408/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4551 - acc: 0.7918 - val_loss: 0.4669 - val_acc: 0.7835\n",
      "Epoch 409/2000\n",
      "514/514 [==============================] - 0s 190us/step - loss: 0.4431 - acc: 0.7802 - val_loss: 0.4676 - val_acc: 0.7913\n",
      "Epoch 410/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4683 - acc: 0.7743 - val_loss: 0.4615 - val_acc: 0.8031\n",
      "Epoch 411/2000\n",
      "514/514 [==============================] - 0s 181us/step - loss: 0.4791 - acc: 0.7432 - val_loss: 0.4786 - val_acc: 0.7677\n",
      "Epoch 412/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4537 - acc: 0.7840 - val_loss: 0.4686 - val_acc: 0.7795\n",
      "Epoch 413/2000\n",
      "514/514 [==============================] - 0s 141us/step - loss: 0.4447 - acc: 0.7821 - val_loss: 0.4782 - val_acc: 0.7677\n",
      "Epoch 414/2000\n",
      "514/514 [==============================] - 0s 188us/step - loss: 0.4716 - acc: 0.7685 - val_loss: 0.4678 - val_acc: 0.7795\n",
      "Epoch 415/2000\n",
      "514/514 [==============================] - 0s 201us/step - loss: 0.5090 - acc: 0.7490 - val_loss: 0.4673 - val_acc: 0.7913\n",
      "Epoch 416/2000\n",
      "514/514 [==============================] - 0s 139us/step - loss: 0.4571 - acc: 0.7704 - val_loss: 0.4649 - val_acc: 0.7953\n",
      "Epoch 417/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4496 - acc: 0.7938 - val_loss: 0.4759 - val_acc: 0.7638\n",
      "Epoch 418/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4479 - acc: 0.7743 - val_loss: 0.5062 - val_acc: 0.7126\n",
      "Epoch 419/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4525 - acc: 0.7918 - val_loss: 0.4690 - val_acc: 0.7913\n",
      "Epoch 420/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4506 - acc: 0.7802 - val_loss: 0.4706 - val_acc: 0.7913\n",
      "Epoch 421/2000\n",
      "514/514 [==============================] - 0s 184us/step - loss: 0.4709 - acc: 0.7646 - val_loss: 0.4653 - val_acc: 0.7953\n",
      "Epoch 422/2000\n",
      "514/514 [==============================] - 0s 91us/step - loss: 0.4525 - acc: 0.7918 - val_loss: 0.4713 - val_acc: 0.7756\n",
      "Epoch 423/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4439 - acc: 0.7860 - val_loss: 0.4702 - val_acc: 0.7677\n",
      "Epoch 424/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4458 - acc: 0.7802 - val_loss: 0.4658 - val_acc: 0.7874\n",
      "Epoch 425/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4627 - acc: 0.7626 - val_loss: 0.4652 - val_acc: 0.7874\n",
      "Epoch 426/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4583 - acc: 0.7704 - val_loss: 0.4679 - val_acc: 0.7953\n",
      "Epoch 427/2000\n",
      "514/514 [==============================] - 0s 166us/step - loss: 0.4485 - acc: 0.7918 - val_loss: 0.4774 - val_acc: 0.7953\n",
      "Epoch 428/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.4823 - acc: 0.7743 - val_loss: 0.4649 - val_acc: 0.7913\n",
      "Epoch 429/2000\n",
      "514/514 [==============================] - 0s 137us/step - loss: 0.4851 - acc: 0.7626 - val_loss: 0.5188 - val_acc: 0.7008\n",
      "Epoch 430/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4609 - acc: 0.7743 - val_loss: 0.5201 - val_acc: 0.6969\n",
      "Epoch 431/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4871 - acc: 0.7724 - val_loss: 0.4663 - val_acc: 0.7913\n",
      "Epoch 432/2000\n",
      "514/514 [==============================] - 0s 192us/step - loss: 0.4559 - acc: 0.7899 - val_loss: 0.4648 - val_acc: 0.7953\n",
      "Epoch 433/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4556 - acc: 0.7840 - val_loss: 0.4681 - val_acc: 0.8031\n",
      "Epoch 434/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4685 - acc: 0.7724 - val_loss: 0.4739 - val_acc: 0.7835\n",
      "Epoch 435/2000\n",
      "514/514 [==============================] - 0s 137us/step - loss: 0.4428 - acc: 0.7802 - val_loss: 0.4684 - val_acc: 0.7756\n",
      "Epoch 436/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.4523 - acc: 0.7821 - val_loss: 0.4662 - val_acc: 0.7953\n",
      "Epoch 437/2000\n",
      "514/514 [==============================] - 0s 139us/step - loss: 0.4675 - acc: 0.7782 - val_loss: 0.4737 - val_acc: 0.7756\n",
      "Epoch 438/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4517 - acc: 0.7821 - val_loss: 0.4686 - val_acc: 0.8031\n",
      "Epoch 439/2000\n",
      "514/514 [==============================] - 0s 139us/step - loss: 0.4508 - acc: 0.7918 - val_loss: 0.4648 - val_acc: 0.7953\n",
      "Epoch 440/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4462 - acc: 0.7879 - val_loss: 0.5140 - val_acc: 0.7717\n",
      "Epoch 441/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.5117 - acc: 0.7529 - val_loss: 0.4699 - val_acc: 0.7874\n",
      "Epoch 442/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4647 - acc: 0.7724 - val_loss: 0.4881 - val_acc: 0.7480\n",
      "Epoch 443/2000\n",
      "514/514 [==============================] - 0s 166us/step - loss: 0.4637 - acc: 0.7607 - val_loss: 0.4770 - val_acc: 0.7598\n",
      "Epoch 444/2000\n",
      "514/514 [==============================] - 0s 254us/step - loss: 0.4479 - acc: 0.7899 - val_loss: 0.4927 - val_acc: 0.7402\n",
      "Epoch 445/2000\n",
      "514/514 [==============================] - 0s 235us/step - loss: 0.4592 - acc: 0.7724 - val_loss: 0.4680 - val_acc: 0.7992\n",
      "Epoch 446/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4483 - acc: 0.7743 - val_loss: 0.4708 - val_acc: 0.7913\n",
      "Epoch 447/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4593 - acc: 0.7743 - val_loss: 0.4700 - val_acc: 0.7953\n",
      "Epoch 448/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4538 - acc: 0.7763 - val_loss: 0.4684 - val_acc: 0.7874\n",
      "Epoch 449/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4675 - acc: 0.7724 - val_loss: 0.4712 - val_acc: 0.7992\n",
      "Epoch 450/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4540 - acc: 0.7802 - val_loss: 0.5013 - val_acc: 0.7244\n",
      "Epoch 451/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4867 - acc: 0.7568 - val_loss: 0.4907 - val_acc: 0.7402\n",
      "Epoch 452/2000\n",
      "514/514 [==============================] - 0s 202us/step - loss: 0.4771 - acc: 0.7646 - val_loss: 0.4803 - val_acc: 0.7913\n",
      "Epoch 453/2000\n",
      "514/514 [==============================] - 0s 233us/step - loss: 0.4740 - acc: 0.7704 - val_loss: 0.4669 - val_acc: 0.7835\n",
      "Epoch 454/2000\n",
      "514/514 [==============================] - 0s 287us/step - loss: 0.4776 - acc: 0.7782 - val_loss: 0.5174 - val_acc: 0.7008\n",
      "Epoch 455/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4529 - acc: 0.7704 - val_loss: 0.4683 - val_acc: 0.7795\n",
      "Epoch 456/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4499 - acc: 0.7763 - val_loss: 0.4883 - val_acc: 0.7520\n",
      "Epoch 457/2000\n",
      "514/514 [==============================] - 0s 169us/step - loss: 0.4589 - acc: 0.7763 - val_loss: 0.4747 - val_acc: 0.7756\n",
      "Epoch 458/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4470 - acc: 0.7957 - val_loss: 0.4725 - val_acc: 0.7953\n",
      "Epoch 459/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4556 - acc: 0.7743 - val_loss: 0.4702 - val_acc: 0.8031\n",
      "Epoch 460/2000\n",
      "514/514 [==============================] - 0s 159us/step - loss: 0.4666 - acc: 0.7568 - val_loss: 0.4714 - val_acc: 0.7717\n",
      "Epoch 461/2000\n",
      "514/514 [==============================] - 0s 165us/step - loss: 0.4474 - acc: 0.7996 - val_loss: 0.4912 - val_acc: 0.7441\n",
      "Epoch 462/2000\n",
      "514/514 [==============================] - 0s 206us/step - loss: 0.4597 - acc: 0.7763 - val_loss: 0.4839 - val_acc: 0.7480\n",
      "Epoch 463/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4602 - acc: 0.7743 - val_loss: 0.4686 - val_acc: 0.7992\n",
      "Epoch 464/2000\n",
      "514/514 [==============================] - 0s 155us/step - loss: 0.4959 - acc: 0.7529 - val_loss: 0.4741 - val_acc: 0.7756\n",
      "Epoch 465/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4596 - acc: 0.7568 - val_loss: 0.4940 - val_acc: 0.7323\n",
      "Epoch 466/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4534 - acc: 0.7704 - val_loss: 0.4827 - val_acc: 0.7638\n",
      "Epoch 467/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4449 - acc: 0.7938 - val_loss: 0.4681 - val_acc: 0.7913\n",
      "Epoch 468/2000\n",
      "514/514 [==============================] - 0s 180us/step - loss: 0.4561 - acc: 0.7665 - val_loss: 0.4717 - val_acc: 0.8031\n",
      "Epoch 469/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4860 - acc: 0.7685 - val_loss: 0.5174 - val_acc: 0.7047\n",
      "Epoch 470/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4514 - acc: 0.7899 - val_loss: 0.4726 - val_acc: 0.7756\n",
      "Epoch 471/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4467 - acc: 0.7918 - val_loss: 0.4628 - val_acc: 0.7913\n",
      "Epoch 472/2000\n",
      "514/514 [==============================] - 0s 211us/step - loss: 0.4616 - acc: 0.7685 - val_loss: 0.4832 - val_acc: 0.7480\n",
      "Epoch 473/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4892 - acc: 0.7743 - val_loss: 0.5130 - val_acc: 0.7087\n",
      "Epoch 474/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 101us/step - loss: 0.4611 - acc: 0.7704 - val_loss: 0.4709 - val_acc: 0.7913\n",
      "Epoch 475/2000\n",
      "514/514 [==============================] - 0s 136us/step - loss: 0.4477 - acc: 0.7860 - val_loss: 0.4757 - val_acc: 0.7520\n",
      "Epoch 476/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4468 - acc: 0.7899 - val_loss: 0.4664 - val_acc: 0.7992\n",
      "Epoch 477/2000\n",
      "514/514 [==============================] - 0s 176us/step - loss: 0.4499 - acc: 0.7938 - val_loss: 0.4749 - val_acc: 0.7795\n",
      "Epoch 478/2000\n",
      "514/514 [==============================] - 0s 203us/step - loss: 0.4435 - acc: 0.7899 - val_loss: 0.4915 - val_acc: 0.7441\n",
      "Epoch 479/2000\n",
      "514/514 [==============================] - 0s 91us/step - loss: 0.4616 - acc: 0.7646 - val_loss: 0.4812 - val_acc: 0.7480\n",
      "Epoch 480/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4456 - acc: 0.7704 - val_loss: 0.4742 - val_acc: 0.7953\n",
      "Epoch 481/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4456 - acc: 0.7743 - val_loss: 0.4695 - val_acc: 0.7874\n",
      "Epoch 482/2000\n",
      "514/514 [==============================] - 0s 91us/step - loss: 0.4446 - acc: 0.7802 - val_loss: 0.4648 - val_acc: 0.7992\n",
      "Epoch 483/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4488 - acc: 0.7763 - val_loss: 0.4625 - val_acc: 0.8071\n",
      "Epoch 484/2000\n",
      "514/514 [==============================] - 0s 91us/step - loss: 0.4615 - acc: 0.7763 - val_loss: 0.4753 - val_acc: 0.7913\n",
      "Epoch 485/2000\n",
      "514/514 [==============================] - 0s 162us/step - loss: 0.4436 - acc: 0.7977 - val_loss: 0.4813 - val_acc: 0.7480\n",
      "Epoch 486/2000\n",
      "514/514 [==============================] - 0s 162us/step - loss: 0.4704 - acc: 0.7724 - val_loss: 0.4719 - val_acc: 0.7756\n",
      "Epoch 487/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4622 - acc: 0.7918 - val_loss: 0.4757 - val_acc: 0.7795\n",
      "Epoch 488/2000\n",
      "514/514 [==============================] - 0s 146us/step - loss: 0.4468 - acc: 0.7763 - val_loss: 0.4813 - val_acc: 0.7520\n",
      "Epoch 489/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4584 - acc: 0.7938 - val_loss: 0.4649 - val_acc: 0.7953\n",
      "Epoch 490/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4584 - acc: 0.7763 - val_loss: 0.4989 - val_acc: 0.7323\n",
      "Epoch 491/2000\n",
      "514/514 [==============================] - 0s 151us/step - loss: 0.4526 - acc: 0.7879 - val_loss: 0.4721 - val_acc: 0.7992\n",
      "Epoch 492/2000\n",
      "514/514 [==============================] - 0s 145us/step - loss: 0.4497 - acc: 0.7860 - val_loss: 0.4672 - val_acc: 0.7717\n",
      "Epoch 493/2000\n",
      "514/514 [==============================] - 0s 192us/step - loss: 0.4652 - acc: 0.7782 - val_loss: 0.4886 - val_acc: 0.7520\n",
      "Epoch 494/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4738 - acc: 0.7763 - val_loss: 0.4760 - val_acc: 0.7717\n",
      "Epoch 495/2000\n",
      "514/514 [==============================] - 0s 150us/step - loss: 0.4649 - acc: 0.7802 - val_loss: 0.4679 - val_acc: 0.7913\n",
      "Epoch 496/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4508 - acc: 0.7860 - val_loss: 0.4767 - val_acc: 0.7874\n",
      "Epoch 497/2000\n",
      "514/514 [==============================] - 0s 136us/step - loss: 0.4585 - acc: 0.7782 - val_loss: 0.4826 - val_acc: 0.7992\n",
      "Epoch 498/2000\n",
      "514/514 [==============================] - 0s 180us/step - loss: 0.4629 - acc: 0.7763 - val_loss: 0.4669 - val_acc: 0.7953\n",
      "Epoch 499/2000\n",
      "514/514 [==============================] - 0s 166us/step - loss: 0.4526 - acc: 0.7802 - val_loss: 0.4689 - val_acc: 0.7913\n",
      "Epoch 500/2000\n",
      "514/514 [==============================] - 0s 145us/step - loss: 0.4414 - acc: 0.7879 - val_loss: 0.4905 - val_acc: 0.7480\n",
      "Epoch 501/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4545 - acc: 0.7763 - val_loss: 0.4719 - val_acc: 0.7756\n",
      "Epoch 502/2000\n",
      "514/514 [==============================] - 0s 144us/step - loss: 0.4653 - acc: 0.7860 - val_loss: 0.4903 - val_acc: 0.7520\n",
      "Epoch 503/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4534 - acc: 0.7840 - val_loss: 0.4657 - val_acc: 0.8031\n",
      "Epoch 504/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4427 - acc: 0.7899 - val_loss: 0.5083 - val_acc: 0.7874\n",
      "Epoch 505/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4689 - acc: 0.7782 - val_loss: 0.4752 - val_acc: 0.7874\n",
      "Epoch 506/2000\n",
      "514/514 [==============================] - 0s 147us/step - loss: 0.4776 - acc: 0.7802 - val_loss: 0.4927 - val_acc: 0.7402\n",
      "Epoch 507/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4553 - acc: 0.7704 - val_loss: 0.4836 - val_acc: 0.7559\n",
      "Epoch 508/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4457 - acc: 0.7821 - val_loss: 0.5000 - val_acc: 0.7283\n",
      "Epoch 509/2000\n",
      "514/514 [==============================] - 0s 162us/step - loss: 0.4683 - acc: 0.7685 - val_loss: 0.4643 - val_acc: 0.7913\n",
      "Epoch 510/2000\n",
      "514/514 [==============================] - 0s 167us/step - loss: 0.4491 - acc: 0.7840 - val_loss: 0.4893 - val_acc: 0.8031\n",
      "Epoch 511/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4616 - acc: 0.7782 - val_loss: 0.4647 - val_acc: 0.7913\n",
      "Epoch 512/2000\n",
      "514/514 [==============================] - 0s 92us/step - loss: 0.4414 - acc: 0.7860 - val_loss: 0.4726 - val_acc: 0.7795\n",
      "Epoch 513/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4755 - acc: 0.7782 - val_loss: 0.4649 - val_acc: 0.8071\n",
      "Epoch 514/2000\n",
      "514/514 [==============================] - 0s 183us/step - loss: 0.4417 - acc: 0.7860 - val_loss: 0.4909 - val_acc: 0.7559\n",
      "Epoch 515/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4549 - acc: 0.7782 - val_loss: 0.4677 - val_acc: 0.7913\n",
      "Epoch 516/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4490 - acc: 0.7743 - val_loss: 0.4808 - val_acc: 0.7913\n",
      "Epoch 517/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4625 - acc: 0.7821 - val_loss: 0.4844 - val_acc: 0.7953\n",
      "Epoch 518/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4616 - acc: 0.7704 - val_loss: 0.4680 - val_acc: 0.7913\n",
      "Epoch 519/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4678 - acc: 0.7646 - val_loss: 0.4761 - val_acc: 0.7795\n",
      "Epoch 520/2000\n",
      "514/514 [==============================] - 0s 137us/step - loss: 0.4465 - acc: 0.7802 - val_loss: 0.4733 - val_acc: 0.7795\n",
      "Epoch 521/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4415 - acc: 0.7802 - val_loss: 0.4741 - val_acc: 0.7835\n",
      "Epoch 522/2000\n",
      "514/514 [==============================] - 0s 185us/step - loss: 0.4410 - acc: 0.7840 - val_loss: 0.4981 - val_acc: 0.7402\n",
      "Epoch 523/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4470 - acc: 0.7802 - val_loss: 0.4890 - val_acc: 0.7441\n",
      "Epoch 524/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.5175 - acc: 0.7412 - val_loss: 0.4905 - val_acc: 0.7677\n",
      "Epoch 525/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4817 - acc: 0.7763 - val_loss: 0.4827 - val_acc: 0.7992\n",
      "Epoch 526/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4498 - acc: 0.7802 - val_loss: 0.4756 - val_acc: 0.7795\n",
      "Epoch 527/2000\n",
      "514/514 [==============================] - 0s 144us/step - loss: 0.4556 - acc: 0.7782 - val_loss: 0.4816 - val_acc: 0.7598\n",
      "Epoch 528/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4457 - acc: 0.7860 - val_loss: 0.4919 - val_acc: 0.7441\n",
      "Epoch 529/2000\n",
      "514/514 [==============================] - 0s 202us/step - loss: 0.4505 - acc: 0.7724 - val_loss: 0.4935 - val_acc: 0.7402\n",
      "Epoch 530/2000\n",
      "514/514 [==============================] - 0s 197us/step - loss: 0.4543 - acc: 0.7743 - val_loss: 0.4653 - val_acc: 0.7992\n",
      "Epoch 531/2000\n",
      "514/514 [==============================] - 0s 153us/step - loss: 0.4625 - acc: 0.7704 - val_loss: 0.4624 - val_acc: 0.8071\n",
      "Epoch 532/2000\n",
      "514/514 [==============================] - 0s 221us/step - loss: 0.4427 - acc: 0.7918 - val_loss: 0.4800 - val_acc: 0.7953\n",
      "Epoch 533/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.4568 - acc: 0.7802 - val_loss: 0.4652 - val_acc: 0.8071\n",
      "Epoch 534/2000\n",
      "514/514 [==============================] - 0s 154us/step - loss: 0.4591 - acc: 0.7957 - val_loss: 0.4744 - val_acc: 0.7756\n",
      "Epoch 535/2000\n",
      "514/514 [==============================] - 0s 137us/step - loss: 0.4456 - acc: 0.7938 - val_loss: 0.4680 - val_acc: 0.7953\n",
      "Epoch 536/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4426 - acc: 0.7782 - val_loss: 0.4661 - val_acc: 0.7953\n",
      "Epoch 537/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4650 - acc: 0.7763 - val_loss: 0.4805 - val_acc: 0.7520\n",
      "Epoch 538/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4444 - acc: 0.7840 - val_loss: 0.4853 - val_acc: 0.7480\n",
      "Epoch 539/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4502 - acc: 0.7802 - val_loss: 0.4685 - val_acc: 0.7795\n",
      "Epoch 540/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4391 - acc: 0.7918 - val_loss: 0.4698 - val_acc: 0.7795\n",
      "Epoch 541/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4641 - acc: 0.7840 - val_loss: 0.4802 - val_acc: 0.7598\n",
      "Epoch 542/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4409 - acc: 0.7743 - val_loss: 0.4815 - val_acc: 0.7520\n",
      "Epoch 543/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4672 - acc: 0.7743 - val_loss: 0.4687 - val_acc: 0.7913\n",
      "Epoch 544/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4334 - acc: 0.7957 - val_loss: 0.4812 - val_acc: 0.7520\n",
      "Epoch 545/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4492 - acc: 0.7802 - val_loss: 0.5173 - val_acc: 0.7126\n",
      "Epoch 546/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.4471 - acc: 0.7860 - val_loss: 0.4679 - val_acc: 0.7795\n",
      "Epoch 547/2000\n",
      "514/514 [==============================] - 0s 152us/step - loss: 0.4479 - acc: 0.7821 - val_loss: 0.4679 - val_acc: 0.7835\n",
      "Epoch 548/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4440 - acc: 0.7840 - val_loss: 0.4670 - val_acc: 0.7874\n",
      "Epoch 549/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4431 - acc: 0.7879 - val_loss: 0.4962 - val_acc: 0.7402\n",
      "Epoch 550/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4564 - acc: 0.7685 - val_loss: 0.4813 - val_acc: 0.7992\n",
      "Epoch 551/2000\n",
      "514/514 [==============================] - 0s 168us/step - loss: 0.4468 - acc: 0.7685 - val_loss: 0.4696 - val_acc: 0.7913\n",
      "Epoch 552/2000\n",
      "514/514 [==============================] - 0s 139us/step - loss: 0.4486 - acc: 0.7899 - val_loss: 0.4841 - val_acc: 0.7441\n",
      "Epoch 553/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4505 - acc: 0.7821 - val_loss: 0.5003 - val_acc: 0.7283\n",
      "Epoch 554/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4517 - acc: 0.7860 - val_loss: 0.4753 - val_acc: 0.7598\n",
      "Epoch 555/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4488 - acc: 0.7821 - val_loss: 0.4879 - val_acc: 0.7559\n",
      "Epoch 556/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4473 - acc: 0.7899 - val_loss: 0.4926 - val_acc: 0.7402\n",
      "Epoch 557/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4378 - acc: 0.7938 - val_loss: 0.4689 - val_acc: 0.7835\n",
      "Epoch 558/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4602 - acc: 0.7840 - val_loss: 0.5094 - val_acc: 0.7126\n",
      "Epoch 559/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.5269 - acc: 0.7160 - val_loss: 0.5160 - val_acc: 0.7362\n",
      "Epoch 560/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4957 - acc: 0.7490 - val_loss: 0.4712 - val_acc: 0.7953\n",
      "Epoch 561/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4704 - acc: 0.7568 - val_loss: 0.5108 - val_acc: 0.7126\n",
      "Epoch 562/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4640 - acc: 0.7802 - val_loss: 0.4768 - val_acc: 0.7756\n",
      "Epoch 563/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4399 - acc: 0.7860 - val_loss: 0.4706 - val_acc: 0.7874\n",
      "Epoch 564/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4422 - acc: 0.7899 - val_loss: 0.4746 - val_acc: 0.7756\n",
      "Epoch 565/2000\n",
      "514/514 [==============================] - 0s 201us/step - loss: 0.4381 - acc: 0.7879 - val_loss: 0.4742 - val_acc: 0.7756\n",
      "Epoch 566/2000\n",
      "514/514 [==============================] - 0s 140us/step - loss: 0.4370 - acc: 0.8016 - val_loss: 0.4852 - val_acc: 0.8031\n",
      "Epoch 567/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4816 - acc: 0.7704 - val_loss: 0.5078 - val_acc: 0.7244\n",
      "Epoch 568/2000\n",
      "514/514 [==============================] - 0s 92us/step - loss: 0.4646 - acc: 0.7607 - val_loss: 0.4868 - val_acc: 0.7559\n",
      "Epoch 569/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4530 - acc: 0.7646 - val_loss: 0.4665 - val_acc: 0.7953\n",
      "Epoch 570/2000\n",
      "514/514 [==============================] - 0s 210us/step - loss: 0.4475 - acc: 0.7802 - val_loss: 0.4704 - val_acc: 0.7874\n",
      "Epoch 571/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4533 - acc: 0.7763 - val_loss: 0.4710 - val_acc: 0.7913\n",
      "Epoch 572/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4473 - acc: 0.7782 - val_loss: 0.4697 - val_acc: 0.7953\n",
      "Epoch 573/2000\n",
      "514/514 [==============================] - 0s 140us/step - loss: 0.4436 - acc: 0.7860 - val_loss: 0.4673 - val_acc: 0.7913\n",
      "Epoch 574/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4402 - acc: 0.7918 - val_loss: 0.4709 - val_acc: 0.7874\n",
      "Epoch 575/2000\n",
      "514/514 [==============================] - 0s 175us/step - loss: 0.4694 - acc: 0.7802 - val_loss: 0.4716 - val_acc: 0.7559\n",
      "Epoch 576/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4703 - acc: 0.7860 - val_loss: 0.4739 - val_acc: 0.7795\n",
      "Epoch 577/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4534 - acc: 0.7724 - val_loss: 0.5376 - val_acc: 0.6969\n",
      "Epoch 578/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4455 - acc: 0.7860 - val_loss: 0.5014 - val_acc: 0.7283\n",
      "Epoch 579/2000\n",
      "514/514 [==============================] - 0s 140us/step - loss: 0.4947 - acc: 0.7529 - val_loss: 0.4623 - val_acc: 0.8071\n",
      "Epoch 580/2000\n",
      "514/514 [==============================] - 0s 153us/step - loss: 0.4447 - acc: 0.7840 - val_loss: 0.4855 - val_acc: 0.7913\n",
      "Epoch 581/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4569 - acc: 0.7802 - val_loss: 0.4814 - val_acc: 0.7520\n",
      "Epoch 582/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4379 - acc: 0.7802 - val_loss: 0.4699 - val_acc: 0.7795\n",
      "Epoch 583/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4371 - acc: 0.7860 - val_loss: 0.4678 - val_acc: 0.7874\n",
      "Epoch 584/2000\n",
      "514/514 [==============================] - 0s 194us/step - loss: 0.4572 - acc: 0.7763 - val_loss: 0.4647 - val_acc: 0.7953\n",
      "Epoch 585/2000\n",
      "514/514 [==============================] - 0s 190us/step - loss: 0.4373 - acc: 0.7860 - val_loss: 0.4680 - val_acc: 0.7953\n",
      "Epoch 586/2000\n",
      "514/514 [==============================] - 0s 167us/step - loss: 0.4382 - acc: 0.7763 - val_loss: 0.4668 - val_acc: 0.7913\n",
      "Epoch 587/2000\n",
      "514/514 [==============================] - 0s 187us/step - loss: 0.4438 - acc: 0.7879 - val_loss: 0.4619 - val_acc: 0.7913\n",
      "Epoch 588/2000\n",
      "514/514 [==============================] - 0s 197us/step - loss: 0.4400 - acc: 0.7860 - val_loss: 0.4956 - val_acc: 0.7362\n",
      "Epoch 589/2000\n",
      "514/514 [==============================] - 0s 237us/step - loss: 0.4768 - acc: 0.7724 - val_loss: 0.4760 - val_acc: 0.7874\n",
      "Epoch 590/2000\n",
      "514/514 [==============================] - 0s 151us/step - loss: 0.4465 - acc: 0.7782 - val_loss: 0.4724 - val_acc: 0.7913\n",
      "Epoch 591/2000\n",
      "514/514 [==============================] - 0s 185us/step - loss: 0.4710 - acc: 0.7568 - val_loss: 0.5001 - val_acc: 0.7205\n",
      "Epoch 592/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 170us/step - loss: 0.4495 - acc: 0.7996 - val_loss: 0.4860 - val_acc: 0.7480\n",
      "Epoch 593/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4448 - acc: 0.7977 - val_loss: 0.4720 - val_acc: 0.7874\n",
      "Epoch 594/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4425 - acc: 0.7899 - val_loss: 0.4687 - val_acc: 0.7874\n",
      "Epoch 595/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4385 - acc: 0.7957 - val_loss: 0.5017 - val_acc: 0.7323\n",
      "Epoch 596/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4424 - acc: 0.7802 - val_loss: 0.4855 - val_acc: 0.7913\n",
      "Epoch 597/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4498 - acc: 0.7840 - val_loss: 0.4768 - val_acc: 0.7598\n",
      "Epoch 598/2000\n",
      "514/514 [==============================] - 0s 92us/step - loss: 0.4403 - acc: 0.7879 - val_loss: 0.4750 - val_acc: 0.7992\n",
      "Epoch 599/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4596 - acc: 0.7782 - val_loss: 0.4716 - val_acc: 0.7874\n",
      "Epoch 600/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4588 - acc: 0.7626 - val_loss: 0.4657 - val_acc: 0.7874\n",
      "Epoch 601/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4532 - acc: 0.7802 - val_loss: 0.4639 - val_acc: 0.7953\n",
      "Epoch 602/2000\n",
      "514/514 [==============================] - 0s 92us/step - loss: 0.4468 - acc: 0.7899 - val_loss: 0.4690 - val_acc: 0.7874\n",
      "Epoch 603/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4765 - acc: 0.7685 - val_loss: 0.4723 - val_acc: 0.7677\n",
      "Epoch 604/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4617 - acc: 0.7704 - val_loss: 0.4715 - val_acc: 0.7717\n",
      "Epoch 605/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4473 - acc: 0.7724 - val_loss: 0.5049 - val_acc: 0.7283\n",
      "Epoch 606/2000\n",
      "514/514 [==============================] - 0s 336us/step - loss: 0.4434 - acc: 0.7802 - val_loss: 0.4772 - val_acc: 0.7598\n",
      "Epoch 607/2000\n",
      "514/514 [==============================] - 0s 92us/step - loss: 0.4382 - acc: 0.7879 - val_loss: 0.4702 - val_acc: 0.7953\n",
      "Epoch 608/2000\n",
      "514/514 [==============================] - 0s 89us/step - loss: 0.4578 - acc: 0.7860 - val_loss: 0.4645 - val_acc: 0.7913\n",
      "Epoch 609/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4374 - acc: 0.7879 - val_loss: 0.4880 - val_acc: 0.7559\n",
      "Epoch 610/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4357 - acc: 0.7977 - val_loss: 0.4759 - val_acc: 0.7638\n",
      "Epoch 611/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4356 - acc: 0.7918 - val_loss: 0.4680 - val_acc: 0.7835\n",
      "Epoch 612/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4359 - acc: 0.7938 - val_loss: 0.4672 - val_acc: 0.7835\n",
      "Epoch 613/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4361 - acc: 0.7918 - val_loss: 0.4833 - val_acc: 0.7520\n",
      "Epoch 614/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4517 - acc: 0.7879 - val_loss: 0.5153 - val_acc: 0.7165\n",
      "Epoch 615/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4622 - acc: 0.7646 - val_loss: 0.4725 - val_acc: 0.7913\n",
      "Epoch 616/2000\n",
      "514/514 [==============================] - 0s 145us/step - loss: 0.4696 - acc: 0.7724 - val_loss: 0.4779 - val_acc: 0.7598\n",
      "Epoch 617/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4639 - acc: 0.7743 - val_loss: 0.4630 - val_acc: 0.7874\n",
      "Epoch 618/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4628 - acc: 0.7510 - val_loss: 0.4805 - val_acc: 0.7992\n",
      "Epoch 619/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4528 - acc: 0.7821 - val_loss: 0.4691 - val_acc: 0.7953\n",
      "Epoch 620/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4400 - acc: 0.7860 - val_loss: 0.4782 - val_acc: 0.8031\n",
      "Epoch 621/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4524 - acc: 0.7840 - val_loss: 0.4722 - val_acc: 0.7953\n",
      "Epoch 622/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4519 - acc: 0.7879 - val_loss: 0.4694 - val_acc: 0.7795\n",
      "Epoch 623/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4417 - acc: 0.7918 - val_loss: 0.4828 - val_acc: 0.7598\n",
      "Epoch 624/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4450 - acc: 0.7977 - val_loss: 0.4782 - val_acc: 0.7677\n",
      "Epoch 625/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4338 - acc: 0.7918 - val_loss: 0.4869 - val_acc: 0.7992\n",
      "Epoch 626/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4720 - acc: 0.7685 - val_loss: 0.5099 - val_acc: 0.7323\n",
      "Epoch 627/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4514 - acc: 0.7821 - val_loss: 0.4689 - val_acc: 0.7913\n",
      "Epoch 628/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4365 - acc: 0.7743 - val_loss: 0.4708 - val_acc: 0.7795\n",
      "Epoch 629/2000\n",
      "514/514 [==============================] - 0s 92us/step - loss: 0.4366 - acc: 0.7724 - val_loss: 0.4800 - val_acc: 0.7559\n",
      "Epoch 630/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4400 - acc: 0.7763 - val_loss: 0.4740 - val_acc: 0.7677\n",
      "Epoch 631/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4360 - acc: 0.7899 - val_loss: 0.4734 - val_acc: 0.8031\n",
      "Epoch 632/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4496 - acc: 0.7938 - val_loss: 0.4792 - val_acc: 0.7953\n",
      "Epoch 633/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4589 - acc: 0.7782 - val_loss: 0.4670 - val_acc: 0.7913\n",
      "Epoch 634/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4499 - acc: 0.7724 - val_loss: 0.4758 - val_acc: 0.8110\n",
      "Epoch 635/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4556 - acc: 0.7879 - val_loss: 0.4620 - val_acc: 0.7992\n",
      "Epoch 636/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4557 - acc: 0.7665 - val_loss: 0.4693 - val_acc: 0.7835\n",
      "Epoch 637/2000\n",
      "514/514 [==============================] - 0s 237us/step - loss: 0.4337 - acc: 0.7840 - val_loss: 0.5007 - val_acc: 0.7402\n",
      "Epoch 638/2000\n",
      "514/514 [==============================] - 0s 191us/step - loss: 0.4719 - acc: 0.7685 - val_loss: 0.4722 - val_acc: 0.7835\n",
      "Epoch 639/2000\n",
      "514/514 [==============================] - 0s 185us/step - loss: 0.4591 - acc: 0.7626 - val_loss: 0.4648 - val_acc: 0.7835\n",
      "Epoch 640/2000\n",
      "514/514 [==============================] - 0s 166us/step - loss: 0.4803 - acc: 0.7646 - val_loss: 0.4716 - val_acc: 0.7953\n",
      "Epoch 641/2000\n",
      "514/514 [==============================] - 0s 313us/step - loss: 0.4515 - acc: 0.7802 - val_loss: 0.4689 - val_acc: 0.7874\n",
      "Epoch 642/2000\n",
      "514/514 [==============================] - 0s 256us/step - loss: 0.4342 - acc: 0.7918 - val_loss: 0.5199 - val_acc: 0.7087\n",
      "Epoch 643/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.5077 - acc: 0.7335 - val_loss: 0.4866 - val_acc: 0.7874\n",
      "Epoch 644/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4520 - acc: 0.7704 - val_loss: 0.4856 - val_acc: 0.7402\n",
      "Epoch 645/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.5552 - acc: 0.7296 - val_loss: 0.5107 - val_acc: 0.7441\n",
      "Epoch 646/2000\n",
      "514/514 [==============================] - 0s 193us/step - loss: 0.4854 - acc: 0.7510 - val_loss: 0.4794 - val_acc: 0.7598\n",
      "Epoch 647/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4451 - acc: 0.7860 - val_loss: 0.4793 - val_acc: 0.7717\n",
      "Epoch 648/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4434 - acc: 0.7840 - val_loss: 0.4735 - val_acc: 0.7992\n",
      "Epoch 649/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4432 - acc: 0.7821 - val_loss: 0.4664 - val_acc: 0.7953\n",
      "Epoch 650/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4461 - acc: 0.7743 - val_loss: 0.4640 - val_acc: 0.7874\n",
      "Epoch 651/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4390 - acc: 0.7821 - val_loss: 0.4659 - val_acc: 0.7874\n",
      "Epoch 652/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4439 - acc: 0.7782 - val_loss: 0.4750 - val_acc: 0.7638\n",
      "Epoch 653/2000\n",
      "514/514 [==============================] - 0s 85us/step - loss: 0.4427 - acc: 0.7899 - val_loss: 0.5082 - val_acc: 0.7244\n",
      "Epoch 654/2000\n",
      "514/514 [==============================] - 0s 90us/step - loss: 0.4507 - acc: 0.7743 - val_loss: 0.4650 - val_acc: 0.7913\n",
      "Epoch 655/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4556 - acc: 0.7918 - val_loss: 0.4826 - val_acc: 0.7992\n",
      "Epoch 656/2000\n",
      "514/514 [==============================] - 0s 90us/step - loss: 0.4626 - acc: 0.7704 - val_loss: 0.4708 - val_acc: 0.7953\n",
      "Epoch 657/2000\n",
      "514/514 [==============================] - 0s 85us/step - loss: 0.4616 - acc: 0.7607 - val_loss: 0.4696 - val_acc: 0.7913\n",
      "Epoch 658/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4725 - acc: 0.7724 - val_loss: 0.5102 - val_acc: 0.7323\n",
      "Epoch 659/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4779 - acc: 0.7490 - val_loss: 0.4811 - val_acc: 0.7913\n",
      "Epoch 660/2000\n",
      "514/514 [==============================] - 0s 167us/step - loss: 0.4444 - acc: 0.7840 - val_loss: 0.4861 - val_acc: 0.7638\n",
      "Epoch 661/2000\n",
      "514/514 [==============================] - 0s 84us/step - loss: 0.4369 - acc: 0.7899 - val_loss: 0.4738 - val_acc: 0.7717\n",
      "Epoch 662/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4437 - acc: 0.7821 - val_loss: 0.4687 - val_acc: 0.7953\n",
      "Epoch 663/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4357 - acc: 0.7860 - val_loss: 0.4758 - val_acc: 0.7677\n",
      "Epoch 664/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4372 - acc: 0.7899 - val_loss: 0.4696 - val_acc: 0.7795\n",
      "Epoch 665/2000\n",
      "514/514 [==============================] - 0s 85us/step - loss: 0.4347 - acc: 0.7879 - val_loss: 0.4757 - val_acc: 0.7677\n",
      "Epoch 666/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4377 - acc: 0.7996 - val_loss: 0.4703 - val_acc: 0.7795\n",
      "Epoch 667/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4480 - acc: 0.7685 - val_loss: 0.4911 - val_acc: 0.7441\n",
      "Epoch 668/2000\n",
      "514/514 [==============================] - 0s 86us/step - loss: 0.4573 - acc: 0.7743 - val_loss: 0.4666 - val_acc: 0.7835\n",
      "Epoch 669/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4338 - acc: 0.7860 - val_loss: 0.4735 - val_acc: 0.7677\n",
      "Epoch 670/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4351 - acc: 0.7899 - val_loss: 0.4696 - val_acc: 0.7795\n",
      "Epoch 671/2000\n",
      "514/514 [==============================] - 0s 209us/step - loss: 0.4442 - acc: 0.7879 - val_loss: 0.4895 - val_acc: 0.7441\n",
      "Epoch 672/2000\n",
      "514/514 [==============================] - 0s 255us/step - loss: 0.4380 - acc: 0.7957 - val_loss: 0.4691 - val_acc: 0.7717\n",
      "Epoch 673/2000\n",
      "514/514 [==============================] - 0s 195us/step - loss: 0.4625 - acc: 0.7626 - val_loss: 0.4708 - val_acc: 0.7953\n",
      "Epoch 674/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4337 - acc: 0.7860 - val_loss: 0.4889 - val_acc: 0.7598\n",
      "Epoch 675/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4397 - acc: 0.7938 - val_loss: 0.4721 - val_acc: 0.7795\n",
      "Epoch 676/2000\n",
      "514/514 [==============================] - 0s 92us/step - loss: 0.4574 - acc: 0.7957 - val_loss: 0.5116 - val_acc: 0.7795\n",
      "Epoch 677/2000\n",
      "514/514 [==============================] - 0s 91us/step - loss: 0.4884 - acc: 0.7549 - val_loss: 0.4691 - val_acc: 0.7874\n",
      "Epoch 678/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4410 - acc: 0.7918 - val_loss: 0.4924 - val_acc: 0.7441\n",
      "Epoch 679/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4348 - acc: 0.7957 - val_loss: 0.4672 - val_acc: 0.7874\n",
      "Epoch 680/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4348 - acc: 0.7879 - val_loss: 0.4888 - val_acc: 0.7480\n",
      "Epoch 681/2000\n",
      "514/514 [==============================] - 0s 215us/step - loss: 0.4576 - acc: 0.7704 - val_loss: 0.4754 - val_acc: 0.7717\n",
      "Epoch 682/2000\n",
      "514/514 [==============================] - 0s 202us/step - loss: 0.4534 - acc: 0.7782 - val_loss: 0.4829 - val_acc: 0.7992\n",
      "Epoch 683/2000\n",
      "514/514 [==============================] - 0s 160us/step - loss: 0.4438 - acc: 0.7802 - val_loss: 0.4750 - val_acc: 0.7795\n",
      "Epoch 684/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4373 - acc: 0.7899 - val_loss: 0.4627 - val_acc: 0.7874\n",
      "Epoch 685/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4379 - acc: 0.7938 - val_loss: 0.4807 - val_acc: 0.7559\n",
      "Epoch 686/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4494 - acc: 0.7782 - val_loss: 0.4707 - val_acc: 0.7835\n",
      "Epoch 687/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4457 - acc: 0.7938 - val_loss: 0.4729 - val_acc: 0.8031\n",
      "Epoch 688/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4578 - acc: 0.7782 - val_loss: 0.4745 - val_acc: 0.7992\n",
      "Epoch 689/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4548 - acc: 0.7782 - val_loss: 0.4874 - val_acc: 0.7520\n",
      "Epoch 690/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4441 - acc: 0.7763 - val_loss: 0.5284 - val_acc: 0.7126\n",
      "Epoch 691/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4659 - acc: 0.7821 - val_loss: 0.4676 - val_acc: 0.7756\n",
      "Epoch 692/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4421 - acc: 0.7918 - val_loss: 0.4664 - val_acc: 0.7913\n",
      "Epoch 693/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4405 - acc: 0.7938 - val_loss: 0.4697 - val_acc: 0.7835\n",
      "Epoch 694/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4400 - acc: 0.7860 - val_loss: 0.4704 - val_acc: 0.7835\n",
      "Epoch 695/2000\n",
      "514/514 [==============================] - 0s 179us/step - loss: 0.4365 - acc: 0.7821 - val_loss: 0.4674 - val_acc: 0.7874\n",
      "Epoch 696/2000\n",
      "514/514 [==============================] - 0s 254us/step - loss: 0.4377 - acc: 0.7821 - val_loss: 0.4699 - val_acc: 0.7874\n",
      "Epoch 697/2000\n",
      "514/514 [==============================] - 0s 136us/step - loss: 0.4308 - acc: 0.7743 - val_loss: 0.5186 - val_acc: 0.7205\n",
      "Epoch 698/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.5338 - acc: 0.7198 - val_loss: 0.4983 - val_acc: 0.7677\n",
      "Epoch 699/2000\n",
      "514/514 [==============================] - 0s 90us/step - loss: 0.4554 - acc: 0.7685 - val_loss: 0.4690 - val_acc: 0.7913\n",
      "Epoch 700/2000\n",
      "514/514 [==============================] - 0s 248us/step - loss: 0.4391 - acc: 0.7977 - val_loss: 0.4626 - val_acc: 0.7913\n",
      "Epoch 701/2000\n",
      "514/514 [==============================] - 0s 201us/step - loss: 0.4392 - acc: 0.7899 - val_loss: 0.4773 - val_acc: 0.8031\n",
      "Epoch 702/2000\n",
      "514/514 [==============================] - 0s 192us/step - loss: 0.4492 - acc: 0.7665 - val_loss: 0.4637 - val_acc: 0.7756\n",
      "Epoch 703/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4438 - acc: 0.7899 - val_loss: 0.4965 - val_acc: 0.7362\n",
      "Epoch 704/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4659 - acc: 0.7782 - val_loss: 0.4840 - val_acc: 0.7638\n",
      "Epoch 705/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.5406 - acc: 0.7101 - val_loss: 0.5504 - val_acc: 0.7323\n",
      "Epoch 706/2000\n",
      "514/514 [==============================] - 0s 164us/step - loss: 0.5272 - acc: 0.7276 - val_loss: 0.4740 - val_acc: 0.8031\n",
      "Epoch 707/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4573 - acc: 0.7763 - val_loss: 0.4732 - val_acc: 0.7795\n",
      "Epoch 708/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.4471 - acc: 0.7802 - val_loss: 0.4770 - val_acc: 0.7992\n",
      "Epoch 709/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4388 - acc: 0.7840 - val_loss: 0.4816 - val_acc: 0.7717\n",
      "Epoch 710/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 131us/step - loss: 0.4401 - acc: 0.7782 - val_loss: 0.4687 - val_acc: 0.7835\n",
      "Epoch 711/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4380 - acc: 0.7918 - val_loss: 0.4865 - val_acc: 0.7441\n",
      "Epoch 712/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4945 - acc: 0.7665 - val_loss: 0.4830 - val_acc: 0.7992\n",
      "Epoch 713/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4257 - acc: 0.7996 - val_loss: 0.5037 - val_acc: 0.7362\n",
      "Epoch 714/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4491 - acc: 0.7840 - val_loss: 0.4718 - val_acc: 0.7756\n",
      "Epoch 715/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4683 - acc: 0.7588 - val_loss: 0.4760 - val_acc: 0.7913\n",
      "Epoch 716/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4486 - acc: 0.7879 - val_loss: 0.4762 - val_acc: 0.7598\n",
      "Epoch 717/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4400 - acc: 0.7782 - val_loss: 0.4765 - val_acc: 0.7638\n",
      "Epoch 718/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4362 - acc: 0.7957 - val_loss: 0.4764 - val_acc: 0.7598\n",
      "Epoch 719/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4451 - acc: 0.7802 - val_loss: 0.4747 - val_acc: 0.7638\n",
      "Epoch 720/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4441 - acc: 0.8054 - val_loss: 0.4693 - val_acc: 0.7953\n",
      "Epoch 721/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4509 - acc: 0.7588 - val_loss: 0.4636 - val_acc: 0.7913\n",
      "Epoch 722/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4876 - acc: 0.7451 - val_loss: 0.4940 - val_acc: 0.7480\n",
      "Epoch 723/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4396 - acc: 0.7899 - val_loss: 0.4782 - val_acc: 0.7913\n",
      "Epoch 724/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4434 - acc: 0.7782 - val_loss: 0.4670 - val_acc: 0.7913\n",
      "Epoch 725/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4415 - acc: 0.7743 - val_loss: 0.4791 - val_acc: 0.7717\n",
      "Epoch 726/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4423 - acc: 0.8016 - val_loss: 0.4646 - val_acc: 0.7874\n",
      "Epoch 727/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4479 - acc: 0.7743 - val_loss: 0.4692 - val_acc: 0.7756\n",
      "Epoch 728/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4417 - acc: 0.7821 - val_loss: 0.4691 - val_acc: 0.7795\n",
      "Epoch 729/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4354 - acc: 0.7763 - val_loss: 0.4682 - val_acc: 0.7835\n",
      "Epoch 730/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4505 - acc: 0.7840 - val_loss: 0.4701 - val_acc: 0.7795\n",
      "Epoch 731/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4482 - acc: 0.7899 - val_loss: 0.4873 - val_acc: 0.7559\n",
      "Epoch 732/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4594 - acc: 0.7646 - val_loss: 0.4690 - val_acc: 0.7795\n",
      "Epoch 733/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4381 - acc: 0.8093 - val_loss: 0.4681 - val_acc: 0.7835\n",
      "Epoch 734/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4650 - acc: 0.7626 - val_loss: 0.4856 - val_acc: 0.7835\n",
      "Epoch 735/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4853 - acc: 0.7568 - val_loss: 0.4904 - val_acc: 0.7480\n",
      "Epoch 736/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4508 - acc: 0.7860 - val_loss: 0.4853 - val_acc: 0.7638\n",
      "Epoch 737/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4349 - acc: 0.7938 - val_loss: 0.4718 - val_acc: 0.8031\n",
      "Epoch 738/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4451 - acc: 0.7763 - val_loss: 0.4698 - val_acc: 0.7795\n",
      "Epoch 739/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4467 - acc: 0.7821 - val_loss: 0.4927 - val_acc: 0.7559\n",
      "Epoch 740/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4402 - acc: 0.7860 - val_loss: 0.4949 - val_acc: 0.7559\n",
      "Epoch 741/2000\n",
      "514/514 [==============================] - 0s 454us/step - loss: 0.4394 - acc: 0.7899 - val_loss: 0.4703 - val_acc: 0.7756\n",
      "Epoch 742/2000\n",
      "514/514 [==============================] - 0s 162us/step - loss: 0.4357 - acc: 0.7879 - val_loss: 0.4716 - val_acc: 0.7795\n",
      "Epoch 743/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4382 - acc: 0.7879 - val_loss: 0.4754 - val_acc: 0.8031\n",
      "Epoch 744/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4453 - acc: 0.7899 - val_loss: 0.4994 - val_acc: 0.7480\n",
      "Epoch 745/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.4362 - acc: 0.7879 - val_loss: 0.4932 - val_acc: 0.7480\n",
      "Epoch 746/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4320 - acc: 0.7860 - val_loss: 0.4734 - val_acc: 0.7992\n",
      "Epoch 747/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4416 - acc: 0.7782 - val_loss: 0.4684 - val_acc: 0.7874\n",
      "Epoch 748/2000\n",
      "514/514 [==============================] - 0s 90us/step - loss: 0.4364 - acc: 0.7763 - val_loss: 0.4762 - val_acc: 0.7717\n",
      "Epoch 749/2000\n",
      "514/514 [==============================] - 0s 92us/step - loss: 0.4412 - acc: 0.7821 - val_loss: 0.4727 - val_acc: 0.7677\n",
      "Epoch 750/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4313 - acc: 0.7899 - val_loss: 0.4749 - val_acc: 0.7756\n",
      "Epoch 751/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4370 - acc: 0.7802 - val_loss: 0.4684 - val_acc: 0.7795\n",
      "Epoch 752/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4318 - acc: 0.7860 - val_loss: 0.4748 - val_acc: 0.7677\n",
      "Epoch 753/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4403 - acc: 0.7743 - val_loss: 0.4688 - val_acc: 0.7717\n",
      "Epoch 754/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4298 - acc: 0.7860 - val_loss: 0.4668 - val_acc: 0.7835\n",
      "Epoch 755/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4329 - acc: 0.7821 - val_loss: 0.4725 - val_acc: 0.7756\n",
      "Epoch 756/2000\n",
      "514/514 [==============================] - 0s 152us/step - loss: 0.4324 - acc: 0.7879 - val_loss: 0.4717 - val_acc: 0.7756\n",
      "Epoch 757/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4634 - acc: 0.7763 - val_loss: 0.4639 - val_acc: 0.7913\n",
      "Epoch 758/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4286 - acc: 0.7977 - val_loss: 0.4728 - val_acc: 0.7717\n",
      "Epoch 759/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4653 - acc: 0.7743 - val_loss: 0.4782 - val_acc: 0.8031\n",
      "Epoch 760/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4620 - acc: 0.7724 - val_loss: 0.5116 - val_acc: 0.7283\n",
      "Epoch 761/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4632 - acc: 0.7665 - val_loss: 0.4929 - val_acc: 0.7480\n",
      "Epoch 762/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4551 - acc: 0.7724 - val_loss: 0.5259 - val_acc: 0.7165\n",
      "Epoch 763/2000\n",
      "514/514 [==============================] - 0s 155us/step - loss: 0.4583 - acc: 0.7782 - val_loss: 0.4846 - val_acc: 0.7598\n",
      "Epoch 764/2000\n",
      "514/514 [==============================] - 0s 197us/step - loss: 0.4511 - acc: 0.7996 - val_loss: 0.4680 - val_acc: 0.7795\n",
      "Epoch 765/2000\n",
      "514/514 [==============================] - 0s 202us/step - loss: 0.4390 - acc: 0.7743 - val_loss: 0.4741 - val_acc: 0.7953\n",
      "Epoch 766/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4509 - acc: 0.7802 - val_loss: 0.4783 - val_acc: 0.7638\n",
      "Epoch 767/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4423 - acc: 0.7918 - val_loss: 0.4686 - val_acc: 0.7795\n",
      "Epoch 768/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4333 - acc: 0.7899 - val_loss: 0.4668 - val_acc: 0.7874\n",
      "Epoch 769/2000\n",
      "514/514 [==============================] - 0s 177us/step - loss: 0.4344 - acc: 0.7860 - val_loss: 0.4736 - val_acc: 0.7756\n",
      "Epoch 770/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4342 - acc: 0.7938 - val_loss: 0.4799 - val_acc: 0.7677\n",
      "Epoch 771/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4306 - acc: 0.7879 - val_loss: 0.4749 - val_acc: 0.7677\n",
      "Epoch 772/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4550 - acc: 0.7840 - val_loss: 0.4642 - val_acc: 0.7992\n",
      "Epoch 773/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4526 - acc: 0.7918 - val_loss: 0.4646 - val_acc: 0.8031\n",
      "Epoch 774/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4499 - acc: 0.7821 - val_loss: 0.4789 - val_acc: 0.7717\n",
      "Epoch 775/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4479 - acc: 0.7918 - val_loss: 0.4885 - val_acc: 0.7441\n",
      "Epoch 776/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4493 - acc: 0.7782 - val_loss: 0.4663 - val_acc: 0.7913\n",
      "Epoch 777/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4365 - acc: 0.7840 - val_loss: 0.4705 - val_acc: 0.7835\n",
      "Epoch 778/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4433 - acc: 0.7957 - val_loss: 0.4703 - val_acc: 0.7795\n",
      "Epoch 779/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.4314 - acc: 0.7938 - val_loss: 0.4670 - val_acc: 0.7795\n",
      "Epoch 780/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4400 - acc: 0.7840 - val_loss: 0.4626 - val_acc: 0.7913\n",
      "Epoch 781/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4564 - acc: 0.7704 - val_loss: 0.5035 - val_acc: 0.7441\n",
      "Epoch 782/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4447 - acc: 0.7957 - val_loss: 0.4745 - val_acc: 0.7953\n",
      "Epoch 783/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4379 - acc: 0.7918 - val_loss: 0.4667 - val_acc: 0.7795\n",
      "Epoch 784/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4379 - acc: 0.7724 - val_loss: 0.4817 - val_acc: 0.7677\n",
      "Epoch 785/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4416 - acc: 0.7918 - val_loss: 0.5072 - val_acc: 0.7323\n",
      "Epoch 786/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4402 - acc: 0.7860 - val_loss: 0.4737 - val_acc: 0.7717\n",
      "Epoch 787/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4434 - acc: 0.7743 - val_loss: 0.4651 - val_acc: 0.7835\n",
      "Epoch 788/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4352 - acc: 0.7879 - val_loss: 0.4689 - val_acc: 0.7953\n",
      "Epoch 789/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4523 - acc: 0.7821 - val_loss: 0.5029 - val_acc: 0.7323\n",
      "Epoch 790/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4414 - acc: 0.7860 - val_loss: 0.4819 - val_acc: 0.7520\n",
      "Epoch 791/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.5899 - acc: 0.6848 - val_loss: 0.4978 - val_acc: 0.7677\n",
      "Epoch 792/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4608 - acc: 0.7704 - val_loss: 0.4785 - val_acc: 0.7835\n",
      "Epoch 793/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4472 - acc: 0.7665 - val_loss: 0.4815 - val_acc: 0.7874\n",
      "Epoch 794/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4407 - acc: 0.7821 - val_loss: 0.4716 - val_acc: 0.7835\n",
      "Epoch 795/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4350 - acc: 0.7821 - val_loss: 0.4662 - val_acc: 0.7874\n",
      "Epoch 796/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4388 - acc: 0.7782 - val_loss: 0.4925 - val_acc: 0.7913\n",
      "Epoch 797/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4754 - acc: 0.7743 - val_loss: 0.4794 - val_acc: 0.7913\n",
      "Epoch 798/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4542 - acc: 0.7782 - val_loss: 0.4769 - val_acc: 0.7638\n",
      "Epoch 799/2000\n",
      "514/514 [==============================] - 0s 216us/step - loss: 0.4381 - acc: 0.7918 - val_loss: 0.4822 - val_acc: 0.7638\n",
      "Epoch 800/2000\n",
      "514/514 [==============================] - 0s 256us/step - loss: 0.4334 - acc: 0.7860 - val_loss: 0.4694 - val_acc: 0.7795\n",
      "Epoch 801/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4302 - acc: 0.7957 - val_loss: 0.4716 - val_acc: 0.7717\n",
      "Epoch 802/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4479 - acc: 0.7782 - val_loss: 0.4684 - val_acc: 0.7677\n",
      "Epoch 803/2000\n",
      "514/514 [==============================] - 0s 162us/step - loss: 0.4313 - acc: 0.7879 - val_loss: 0.4751 - val_acc: 0.7677\n",
      "Epoch 804/2000\n",
      "514/514 [==============================] - 0s 259us/step - loss: 0.4381 - acc: 0.7840 - val_loss: 0.4847 - val_acc: 0.7559\n",
      "Epoch 805/2000\n",
      "514/514 [==============================] - 0s 223us/step - loss: 0.4578 - acc: 0.7821 - val_loss: 0.4644 - val_acc: 0.7756\n",
      "Epoch 806/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4309 - acc: 0.8054 - val_loss: 0.4845 - val_acc: 0.7913\n",
      "Epoch 807/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4517 - acc: 0.7860 - val_loss: 0.4943 - val_acc: 0.7402\n",
      "Epoch 808/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4436 - acc: 0.7802 - val_loss: 0.4635 - val_acc: 0.7835\n",
      "Epoch 809/2000\n",
      "514/514 [==============================] - 0s 156us/step - loss: 0.4380 - acc: 0.7957 - val_loss: 0.4659 - val_acc: 0.7874\n",
      "Epoch 810/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4643 - acc: 0.7782 - val_loss: 0.4923 - val_acc: 0.7441\n",
      "Epoch 811/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4571 - acc: 0.7782 - val_loss: 0.4738 - val_acc: 0.7835\n",
      "Epoch 812/2000\n",
      "514/514 [==============================] - 0s 154us/step - loss: 0.4684 - acc: 0.7607 - val_loss: 0.4694 - val_acc: 0.7953\n",
      "Epoch 813/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4513 - acc: 0.7899 - val_loss: 0.4736 - val_acc: 0.7913\n",
      "Epoch 814/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4368 - acc: 0.7840 - val_loss: 0.4756 - val_acc: 0.7717\n",
      "Epoch 815/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4344 - acc: 0.7899 - val_loss: 0.4740 - val_acc: 0.7717\n",
      "Epoch 816/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4397 - acc: 0.7860 - val_loss: 0.4673 - val_acc: 0.7835\n",
      "Epoch 817/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4309 - acc: 0.7840 - val_loss: 0.4715 - val_acc: 0.7756\n",
      "Epoch 818/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4407 - acc: 0.7899 - val_loss: 0.4852 - val_acc: 0.7559\n",
      "Epoch 819/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4464 - acc: 0.7879 - val_loss: 0.4996 - val_acc: 0.7520\n",
      "Epoch 820/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4411 - acc: 0.7996 - val_loss: 0.4814 - val_acc: 0.7559\n",
      "Epoch 821/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4367 - acc: 0.7918 - val_loss: 0.4883 - val_acc: 0.7559\n",
      "Epoch 822/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4472 - acc: 0.7802 - val_loss: 0.4694 - val_acc: 0.7717\n",
      "Epoch 823/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4310 - acc: 0.7879 - val_loss: 0.4721 - val_acc: 0.7717\n",
      "Epoch 824/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4461 - acc: 0.7957 - val_loss: 0.4683 - val_acc: 0.7795\n",
      "Epoch 825/2000\n",
      "514/514 [==============================] - 0s 165us/step - loss: 0.4295 - acc: 0.7957 - val_loss: 0.4714 - val_acc: 0.7756\n",
      "Epoch 826/2000\n",
      "514/514 [==============================] - 0s 161us/step - loss: 0.4331 - acc: 0.7802 - val_loss: 0.4639 - val_acc: 0.7756\n",
      "Epoch 827/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4433 - acc: 0.7782 - val_loss: 0.4664 - val_acc: 0.7874\n",
      "Epoch 828/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 121us/step - loss: 0.4368 - acc: 0.7918 - val_loss: 0.4916 - val_acc: 0.7441\n",
      "Epoch 829/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4362 - acc: 0.7840 - val_loss: 0.4831 - val_acc: 0.7559\n",
      "Epoch 830/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4426 - acc: 0.7802 - val_loss: 0.4862 - val_acc: 0.8031\n",
      "Epoch 831/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4554 - acc: 0.7860 - val_loss: 0.4839 - val_acc: 0.7992\n",
      "Epoch 832/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4432 - acc: 0.7899 - val_loss: 0.5019 - val_acc: 0.7441\n",
      "Epoch 833/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4504 - acc: 0.7704 - val_loss: 0.4720 - val_acc: 0.7677\n",
      "Epoch 834/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4374 - acc: 0.7879 - val_loss: 0.4705 - val_acc: 0.7953\n",
      "Epoch 835/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4373 - acc: 0.7802 - val_loss: 0.4792 - val_acc: 0.7992\n",
      "Epoch 836/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4992 - acc: 0.7607 - val_loss: 0.4792 - val_acc: 0.7441\n",
      "Epoch 837/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4431 - acc: 0.7879 - val_loss: 0.4907 - val_acc: 0.7480\n",
      "Epoch 838/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4477 - acc: 0.7860 - val_loss: 0.4896 - val_acc: 0.7598\n",
      "Epoch 839/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4489 - acc: 0.7802 - val_loss: 0.4684 - val_acc: 0.7913\n",
      "Epoch 840/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4367 - acc: 0.7918 - val_loss: 0.4688 - val_acc: 0.7795\n",
      "Epoch 841/2000\n",
      "514/514 [==============================] - 0s 224us/step - loss: 0.4383 - acc: 0.7840 - val_loss: 0.4927 - val_acc: 0.7520\n",
      "Epoch 842/2000\n",
      "514/514 [==============================] - 0s 229us/step - loss: 0.4335 - acc: 0.8035 - val_loss: 0.4679 - val_acc: 0.7835\n",
      "Epoch 843/2000\n",
      "514/514 [==============================] - 0s 233us/step - loss: 0.4289 - acc: 0.7996 - val_loss: 0.4641 - val_acc: 0.7795\n",
      "Epoch 844/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4294 - acc: 0.7918 - val_loss: 0.4725 - val_acc: 0.7677\n",
      "Epoch 845/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4397 - acc: 0.7763 - val_loss: 0.4836 - val_acc: 0.7559\n",
      "Epoch 846/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4365 - acc: 0.8016 - val_loss: 0.4677 - val_acc: 0.7677\n",
      "Epoch 847/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4326 - acc: 0.7879 - val_loss: 0.4676 - val_acc: 0.7874\n",
      "Epoch 848/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4265 - acc: 0.7802 - val_loss: 0.4823 - val_acc: 0.7598\n",
      "Epoch 849/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4439 - acc: 0.7802 - val_loss: 0.4780 - val_acc: 0.7677\n",
      "Epoch 850/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4421 - acc: 0.7918 - val_loss: 0.5584 - val_acc: 0.6850\n",
      "Epoch 851/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4784 - acc: 0.7510 - val_loss: 0.4700 - val_acc: 0.7835\n",
      "Epoch 852/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4477 - acc: 0.7899 - val_loss: 0.4696 - val_acc: 0.7953\n",
      "Epoch 853/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4357 - acc: 0.7899 - val_loss: 0.4773 - val_acc: 0.7913\n",
      "Epoch 854/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4332 - acc: 0.7860 - val_loss: 0.4672 - val_acc: 0.7913\n",
      "Epoch 855/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4306 - acc: 0.7899 - val_loss: 0.4810 - val_acc: 0.7598\n",
      "Epoch 856/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4476 - acc: 0.7763 - val_loss: 0.4937 - val_acc: 0.7953\n",
      "Epoch 857/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4779 - acc: 0.7646 - val_loss: 0.4700 - val_acc: 0.7795\n",
      "Epoch 858/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4310 - acc: 0.7918 - val_loss: 0.4760 - val_acc: 0.7638\n",
      "Epoch 859/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4323 - acc: 0.7899 - val_loss: 0.4857 - val_acc: 0.7559\n",
      "Epoch 860/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4324 - acc: 0.7899 - val_loss: 0.5396 - val_acc: 0.7047\n",
      "Epoch 861/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.5183 - acc: 0.7588 - val_loss: 0.4676 - val_acc: 0.7992\n",
      "Epoch 862/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4363 - acc: 0.7899 - val_loss: 0.4985 - val_acc: 0.7402\n",
      "Epoch 863/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4686 - acc: 0.7782 - val_loss: 0.4730 - val_acc: 0.7598\n",
      "Epoch 864/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4384 - acc: 0.7899 - val_loss: 0.4700 - val_acc: 0.7874\n",
      "Epoch 865/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4299 - acc: 0.7918 - val_loss: 0.4650 - val_acc: 0.7756\n",
      "Epoch 866/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4481 - acc: 0.8016 - val_loss: 0.4812 - val_acc: 0.7520\n",
      "Epoch 867/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4325 - acc: 0.7996 - val_loss: 0.4730 - val_acc: 0.7835\n",
      "Epoch 868/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4406 - acc: 0.8016 - val_loss: 0.4801 - val_acc: 0.7756\n",
      "Epoch 869/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4445 - acc: 0.7802 - val_loss: 0.4754 - val_acc: 0.7913\n",
      "Epoch 870/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4559 - acc: 0.7704 - val_loss: 0.4788 - val_acc: 0.7913\n",
      "Epoch 871/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4541 - acc: 0.7821 - val_loss: 0.5010 - val_acc: 0.7362\n",
      "Epoch 872/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4385 - acc: 0.7782 - val_loss: 0.4694 - val_acc: 0.7717\n",
      "Epoch 873/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4354 - acc: 0.7840 - val_loss: 0.4708 - val_acc: 0.7874\n",
      "Epoch 874/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4614 - acc: 0.7646 - val_loss: 0.5182 - val_acc: 0.7835\n",
      "Epoch 875/2000\n",
      "514/514 [==============================] - 0s 156us/step - loss: 0.4374 - acc: 0.7938 - val_loss: 0.4761 - val_acc: 0.7598\n",
      "Epoch 876/2000\n",
      "514/514 [==============================] - 0s 179us/step - loss: 0.4438 - acc: 0.7704 - val_loss: 0.4728 - val_acc: 0.7638\n",
      "Epoch 877/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4322 - acc: 0.7840 - val_loss: 0.4757 - val_acc: 0.7598\n",
      "Epoch 878/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4520 - acc: 0.7782 - val_loss: 0.4799 - val_acc: 0.7323\n",
      "Epoch 879/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4398 - acc: 0.7957 - val_loss: 0.5056 - val_acc: 0.7953\n",
      "Epoch 880/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4601 - acc: 0.7879 - val_loss: 0.4877 - val_acc: 0.7441\n",
      "Epoch 881/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4346 - acc: 0.8035 - val_loss: 0.4813 - val_acc: 0.7598\n",
      "Epoch 882/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4588 - acc: 0.7704 - val_loss: 0.4717 - val_acc: 0.7913\n",
      "Epoch 883/2000\n",
      "514/514 [==============================] - 0s 136us/step - loss: 0.4347 - acc: 0.7860 - val_loss: 0.4613 - val_acc: 0.7913\n",
      "Epoch 884/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4349 - acc: 0.7763 - val_loss: 0.4684 - val_acc: 0.7913\n",
      "Epoch 885/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4302 - acc: 0.7879 - val_loss: 0.4686 - val_acc: 0.7795\n",
      "Epoch 886/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4477 - acc: 0.7802 - val_loss: 0.4838 - val_acc: 0.7402\n",
      "Epoch 887/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4372 - acc: 0.7899 - val_loss: 0.4713 - val_acc: 0.7913\n",
      "Epoch 888/2000\n",
      "514/514 [==============================] - 0s 146us/step - loss: 0.4365 - acc: 0.7802 - val_loss: 0.4833 - val_acc: 0.7638\n",
      "Epoch 889/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4331 - acc: 0.7879 - val_loss: 0.4693 - val_acc: 0.7717\n",
      "Epoch 890/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4481 - acc: 0.7763 - val_loss: 0.4687 - val_acc: 0.7913\n",
      "Epoch 891/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4336 - acc: 0.8016 - val_loss: 0.4789 - val_acc: 0.7520\n",
      "Epoch 892/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4522 - acc: 0.7899 - val_loss: 0.4877 - val_acc: 0.7953\n",
      "Epoch 893/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4391 - acc: 0.8093 - val_loss: 0.4811 - val_acc: 0.7717\n",
      "Epoch 894/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4313 - acc: 0.7957 - val_loss: 0.4731 - val_acc: 0.7795\n",
      "Epoch 895/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4287 - acc: 0.7879 - val_loss: 0.4836 - val_acc: 0.7520\n",
      "Epoch 896/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4329 - acc: 0.7840 - val_loss: 0.4715 - val_acc: 0.7677\n",
      "Epoch 897/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4319 - acc: 0.7821 - val_loss: 0.4750 - val_acc: 0.7717\n",
      "Epoch 898/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4286 - acc: 0.7938 - val_loss: 0.5074 - val_acc: 0.7953\n",
      "Epoch 899/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4820 - acc: 0.7743 - val_loss: 0.4689 - val_acc: 0.7795\n",
      "Epoch 900/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4399 - acc: 0.7821 - val_loss: 0.4895 - val_acc: 0.7559\n",
      "Epoch 901/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4282 - acc: 0.7938 - val_loss: 0.4701 - val_acc: 0.7835\n",
      "Epoch 902/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4294 - acc: 0.7821 - val_loss: 0.4804 - val_acc: 0.7638\n",
      "Epoch 903/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4288 - acc: 0.7899 - val_loss: 0.4698 - val_acc: 0.7756\n",
      "Epoch 904/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4260 - acc: 0.7957 - val_loss: 0.4875 - val_acc: 0.7520\n",
      "Epoch 905/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4561 - acc: 0.7840 - val_loss: 0.4688 - val_acc: 0.7717\n",
      "Epoch 906/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4260 - acc: 0.7977 - val_loss: 0.4747 - val_acc: 0.7717\n",
      "Epoch 907/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4274 - acc: 0.7977 - val_loss: 0.4703 - val_acc: 0.7835\n",
      "Epoch 908/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4357 - acc: 0.7879 - val_loss: 0.4900 - val_acc: 0.8031\n",
      "Epoch 909/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4398 - acc: 0.7802 - val_loss: 0.4736 - val_acc: 0.7520\n",
      "Epoch 910/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4328 - acc: 0.7918 - val_loss: 0.4959 - val_acc: 0.7520\n",
      "Epoch 911/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4601 - acc: 0.7821 - val_loss: 0.4894 - val_acc: 0.7953\n",
      "Epoch 912/2000\n",
      "514/514 [==============================] - 0s 146us/step - loss: 0.4583 - acc: 0.7743 - val_loss: 0.4741 - val_acc: 0.7795\n",
      "Epoch 913/2000\n",
      "514/514 [==============================] - 0s 224us/step - loss: 0.4384 - acc: 0.7879 - val_loss: 0.4748 - val_acc: 0.7835\n",
      "Epoch 914/2000\n",
      "514/514 [==============================] - 0s 149us/step - loss: 0.4363 - acc: 0.7860 - val_loss: 0.4711 - val_acc: 0.7638\n",
      "Epoch 915/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4361 - acc: 0.7802 - val_loss: 0.4667 - val_acc: 0.7835\n",
      "Epoch 916/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4402 - acc: 0.7782 - val_loss: 0.4752 - val_acc: 0.8071\n",
      "Epoch 917/2000\n",
      "514/514 [==============================] - 0s 200us/step - loss: 0.4326 - acc: 0.7918 - val_loss: 0.4742 - val_acc: 0.7835\n",
      "Epoch 918/2000\n",
      "514/514 [==============================] - 0s 197us/step - loss: 0.4347 - acc: 0.7879 - val_loss: 0.5045 - val_acc: 0.7323\n",
      "Epoch 919/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4395 - acc: 0.7840 - val_loss: 0.4856 - val_acc: 0.7520\n",
      "Epoch 920/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4482 - acc: 0.7879 - val_loss: 0.4785 - val_acc: 0.7795\n",
      "Epoch 921/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4345 - acc: 0.7899 - val_loss: 0.4775 - val_acc: 0.8071\n",
      "Epoch 922/2000\n",
      "514/514 [==============================] - 0s 317us/step - loss: 0.4364 - acc: 0.8016 - val_loss: 0.4717 - val_acc: 0.7677\n",
      "Epoch 923/2000\n",
      "514/514 [==============================] - 0s 228us/step - loss: 0.4338 - acc: 0.8016 - val_loss: 0.4771 - val_acc: 0.7874\n",
      "Epoch 924/2000\n",
      "514/514 [==============================] - 0s 222us/step - loss: 0.4356 - acc: 0.7996 - val_loss: 0.4703 - val_acc: 0.7717\n",
      "Epoch 925/2000\n",
      "514/514 [==============================] - 0s 232us/step - loss: 0.4295 - acc: 0.7938 - val_loss: 0.4811 - val_acc: 0.7638\n",
      "Epoch 926/2000\n",
      "514/514 [==============================] - 0s 187us/step - loss: 0.4344 - acc: 0.7879 - val_loss: 0.4755 - val_acc: 0.7598\n",
      "Epoch 927/2000\n",
      "514/514 [==============================] - 0s 166us/step - loss: 0.4403 - acc: 0.7977 - val_loss: 0.5232 - val_acc: 0.7165\n",
      "Epoch 928/2000\n",
      "514/514 [==============================] - 0s 249us/step - loss: 0.4484 - acc: 0.7802 - val_loss: 0.4728 - val_acc: 0.7638\n",
      "Epoch 929/2000\n",
      "514/514 [==============================] - 0s 202us/step - loss: 0.4314 - acc: 0.7938 - val_loss: 0.4962 - val_acc: 0.7480\n",
      "Epoch 930/2000\n",
      "514/514 [==============================] - 0s 188us/step - loss: 0.4474 - acc: 0.7879 - val_loss: 0.4814 - val_acc: 0.7520\n",
      "Epoch 931/2000\n",
      "514/514 [==============================] - 0s 230us/step - loss: 0.4346 - acc: 0.7899 - val_loss: 0.4830 - val_acc: 0.7638\n",
      "Epoch 932/2000\n",
      "514/514 [==============================] - 0s 214us/step - loss: 0.4241 - acc: 0.7938 - val_loss: 0.4688 - val_acc: 0.7835\n",
      "Epoch 933/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4278 - acc: 0.7957 - val_loss: 0.4771 - val_acc: 0.7480\n",
      "Epoch 934/2000\n",
      "514/514 [==============================] - 0s 225us/step - loss: 0.4819 - acc: 0.7626 - val_loss: 0.4912 - val_acc: 0.7283\n",
      "Epoch 935/2000\n",
      "514/514 [==============================] - 0s 221us/step - loss: 0.4449 - acc: 0.7860 - val_loss: 0.4712 - val_acc: 0.7835\n",
      "Epoch 936/2000\n",
      "514/514 [==============================] - 0s 186us/step - loss: 0.4274 - acc: 0.7821 - val_loss: 0.4807 - val_acc: 0.7598\n",
      "Epoch 937/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4389 - acc: 0.7977 - val_loss: 0.4813 - val_acc: 0.7598\n",
      "Epoch 938/2000\n",
      "514/514 [==============================] - 0s 197us/step - loss: 0.4591 - acc: 0.7860 - val_loss: 0.4678 - val_acc: 0.7677\n",
      "Epoch 939/2000\n",
      "514/514 [==============================] - 0s 193us/step - loss: 0.4436 - acc: 0.7879 - val_loss: 0.4717 - val_acc: 0.7598\n",
      "Epoch 940/2000\n",
      "514/514 [==============================] - 0s 221us/step - loss: 0.4576 - acc: 0.7763 - val_loss: 0.4926 - val_acc: 0.7520\n",
      "Epoch 941/2000\n",
      "514/514 [==============================] - 0s 143us/step - loss: 0.4721 - acc: 0.7626 - val_loss: 0.4923 - val_acc: 0.7874\n",
      "Epoch 942/2000\n",
      "514/514 [==============================] - 0s 213us/step - loss: 0.4543 - acc: 0.7996 - val_loss: 0.4686 - val_acc: 0.7756\n",
      "Epoch 943/2000\n",
      "514/514 [==============================] - 0s 282us/step - loss: 0.4367 - acc: 0.7704 - val_loss: 0.4679 - val_acc: 0.7756\n",
      "Epoch 944/2000\n",
      "514/514 [==============================] - 0s 157us/step - loss: 0.4450 - acc: 0.7763 - val_loss: 0.4664 - val_acc: 0.7874\n",
      "Epoch 945/2000\n",
      "514/514 [==============================] - 0s 150us/step - loss: 0.4422 - acc: 0.7685 - val_loss: 0.5295 - val_acc: 0.7087\n",
      "Epoch 946/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 124us/step - loss: 0.4745 - acc: 0.7568 - val_loss: 0.4872 - val_acc: 0.7441\n",
      "Epoch 947/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4611 - acc: 0.7763 - val_loss: 0.4814 - val_acc: 0.7756\n",
      "Epoch 948/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4442 - acc: 0.7957 - val_loss: 0.4828 - val_acc: 0.7913\n",
      "Epoch 949/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4416 - acc: 0.7840 - val_loss: 0.4692 - val_acc: 0.7795\n",
      "Epoch 950/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4533 - acc: 0.7879 - val_loss: 0.4689 - val_acc: 0.7874\n",
      "Epoch 951/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4259 - acc: 0.7899 - val_loss: 0.4681 - val_acc: 0.7874\n",
      "Epoch 952/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4268 - acc: 0.7860 - val_loss: 0.4686 - val_acc: 0.7795\n",
      "Epoch 953/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4364 - acc: 0.7899 - val_loss: 0.4970 - val_acc: 0.7480\n",
      "Epoch 954/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4376 - acc: 0.7860 - val_loss: 0.4812 - val_acc: 0.7638\n",
      "Epoch 955/2000\n",
      "514/514 [==============================] - 0s 222us/step - loss: 0.4382 - acc: 0.7704 - val_loss: 0.4813 - val_acc: 0.7913\n",
      "Epoch 956/2000\n",
      "514/514 [==============================] - 0s 187us/step - loss: 0.4376 - acc: 0.7977 - val_loss: 0.4665 - val_acc: 0.7756\n",
      "Epoch 957/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4483 - acc: 0.7743 - val_loss: 0.4892 - val_acc: 0.7441\n",
      "Epoch 958/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4448 - acc: 0.7821 - val_loss: 0.4896 - val_acc: 0.7480\n",
      "Epoch 959/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4344 - acc: 0.7879 - val_loss: 0.4668 - val_acc: 0.7795\n",
      "Epoch 960/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4383 - acc: 0.7957 - val_loss: 0.4657 - val_acc: 0.7874\n",
      "Epoch 961/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4303 - acc: 0.8016 - val_loss: 0.4919 - val_acc: 0.7441\n",
      "Epoch 962/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4318 - acc: 0.7957 - val_loss: 0.4745 - val_acc: 0.7717\n",
      "Epoch 963/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4295 - acc: 0.7879 - val_loss: 0.5232 - val_acc: 0.7165\n",
      "Epoch 964/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4379 - acc: 0.7743 - val_loss: 0.4701 - val_acc: 0.7756\n",
      "Epoch 965/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4358 - acc: 0.7899 - val_loss: 0.4709 - val_acc: 0.7835\n",
      "Epoch 966/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4495 - acc: 0.7899 - val_loss: 0.4688 - val_acc: 0.7756\n",
      "Epoch 967/2000\n",
      "514/514 [==============================] - 0s 230us/step - loss: 0.4415 - acc: 0.7782 - val_loss: 0.4742 - val_acc: 0.7677\n",
      "Epoch 968/2000\n",
      "514/514 [==============================] - 0s 200us/step - loss: 0.4256 - acc: 0.7977 - val_loss: 0.4678 - val_acc: 0.7756\n",
      "Epoch 969/2000\n",
      "514/514 [==============================] - 0s 199us/step - loss: 0.4262 - acc: 0.7899 - val_loss: 0.4686 - val_acc: 0.7717\n",
      "Epoch 970/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4285 - acc: 0.7860 - val_loss: 0.4712 - val_acc: 0.7756\n",
      "Epoch 971/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4800 - acc: 0.7743 - val_loss: 0.4712 - val_acc: 0.7559\n",
      "Epoch 972/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4364 - acc: 0.7782 - val_loss: 0.4824 - val_acc: 0.7559\n",
      "Epoch 973/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4465 - acc: 0.7957 - val_loss: 0.5128 - val_acc: 0.7244\n",
      "Epoch 974/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4455 - acc: 0.7860 - val_loss: 0.4869 - val_acc: 0.7598\n",
      "Epoch 975/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4441 - acc: 0.7918 - val_loss: 0.4716 - val_acc: 0.7559\n",
      "Epoch 976/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4383 - acc: 0.7860 - val_loss: 0.4728 - val_acc: 0.7874\n",
      "Epoch 977/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4291 - acc: 0.7957 - val_loss: 0.5161 - val_acc: 0.7244\n",
      "Epoch 978/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4709 - acc: 0.7782 - val_loss: 0.5066 - val_acc: 0.7913\n",
      "Epoch 979/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4339 - acc: 0.7879 - val_loss: 0.4802 - val_acc: 0.7559\n",
      "Epoch 980/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4241 - acc: 0.7879 - val_loss: 0.4687 - val_acc: 0.7717\n",
      "Epoch 981/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4270 - acc: 0.8016 - val_loss: 0.4701 - val_acc: 0.7677\n",
      "Epoch 982/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4250 - acc: 0.7996 - val_loss: 0.4734 - val_acc: 0.7795\n",
      "Epoch 983/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4246 - acc: 0.8035 - val_loss: 0.4740 - val_acc: 0.7756\n",
      "Epoch 984/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4357 - acc: 0.7918 - val_loss: 0.4723 - val_acc: 0.7598\n",
      "Epoch 985/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4441 - acc: 0.7899 - val_loss: 0.4679 - val_acc: 0.7835\n",
      "Epoch 986/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4393 - acc: 0.7802 - val_loss: 0.4928 - val_acc: 0.7441\n",
      "Epoch 987/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.5478 - acc: 0.7121 - val_loss: 0.5160 - val_acc: 0.7559\n",
      "Epoch 988/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4673 - acc: 0.7646 - val_loss: 0.5156 - val_acc: 0.7126\n",
      "Epoch 989/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4722 - acc: 0.7704 - val_loss: 0.4936 - val_acc: 0.7913\n",
      "Epoch 990/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4610 - acc: 0.7802 - val_loss: 0.4816 - val_acc: 0.8071\n",
      "Epoch 991/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4652 - acc: 0.7432 - val_loss: 0.4751 - val_acc: 0.7795\n",
      "Epoch 992/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4434 - acc: 0.7977 - val_loss: 0.4794 - val_acc: 0.7795\n",
      "Epoch 993/2000\n",
      "514/514 [==============================] - 0s 139us/step - loss: 0.4365 - acc: 0.7957 - val_loss: 0.4721 - val_acc: 0.7717\n",
      "Epoch 994/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4247 - acc: 0.7996 - val_loss: 0.4712 - val_acc: 0.7677\n",
      "Epoch 995/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4416 - acc: 0.7821 - val_loss: 0.5024 - val_acc: 0.7362\n",
      "Epoch 996/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4551 - acc: 0.7763 - val_loss: 0.4685 - val_acc: 0.7756\n",
      "Epoch 997/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4303 - acc: 0.7840 - val_loss: 0.4859 - val_acc: 0.7559\n",
      "Epoch 998/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4610 - acc: 0.7704 - val_loss: 0.4677 - val_acc: 0.7756\n",
      "Epoch 999/2000\n",
      "514/514 [==============================] - 0s 137us/step - loss: 0.4510 - acc: 0.7802 - val_loss: 0.4677 - val_acc: 0.7717\n",
      "Epoch 1000/2000\n",
      "514/514 [==============================] - 0s 158us/step - loss: 0.4288 - acc: 0.7899 - val_loss: 0.4788 - val_acc: 0.7717\n",
      "Epoch 1001/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4248 - acc: 0.7918 - val_loss: 0.4761 - val_acc: 0.7717\n",
      "Epoch 1002/2000\n",
      "514/514 [==============================] - 0s 136us/step - loss: 0.4412 - acc: 0.7802 - val_loss: 0.4878 - val_acc: 0.7598\n",
      "Epoch 1003/2000\n",
      "514/514 [==============================] - 0s 143us/step - loss: 0.4228 - acc: 0.7996 - val_loss: 0.4784 - val_acc: 0.7717\n",
      "Epoch 1004/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4470 - acc: 0.7879 - val_loss: 0.5041 - val_acc: 0.7953\n",
      "Epoch 1005/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4862 - acc: 0.7743 - val_loss: 0.4852 - val_acc: 0.7402\n",
      "Epoch 1006/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4576 - acc: 0.7646 - val_loss: 0.4796 - val_acc: 0.7441\n",
      "Epoch 1007/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4375 - acc: 0.7860 - val_loss: 0.4679 - val_acc: 0.7717\n",
      "Epoch 1008/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4248 - acc: 0.7996 - val_loss: 0.4703 - val_acc: 0.7874\n",
      "Epoch 1009/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4418 - acc: 0.7879 - val_loss: 0.4773 - val_acc: 0.7717\n",
      "Epoch 1010/2000\n",
      "514/514 [==============================] - 0s 84us/step - loss: 0.4367 - acc: 0.7899 - val_loss: 0.4692 - val_acc: 0.7717\n",
      "Epoch 1011/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4372 - acc: 0.7685 - val_loss: 0.4665 - val_acc: 0.7795\n",
      "Epoch 1012/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4264 - acc: 0.7899 - val_loss: 0.4668 - val_acc: 0.7795\n",
      "Epoch 1013/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4259 - acc: 0.7860 - val_loss: 0.4684 - val_acc: 0.7795\n",
      "Epoch 1014/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4227 - acc: 0.7879 - val_loss: 0.4696 - val_acc: 0.7717\n",
      "Epoch 1015/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4259 - acc: 0.7899 - val_loss: 0.4716 - val_acc: 0.7835\n",
      "Epoch 1016/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4994 - acc: 0.7626 - val_loss: 0.4805 - val_acc: 0.7441\n",
      "Epoch 1017/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4430 - acc: 0.7879 - val_loss: 0.4908 - val_acc: 0.7559\n",
      "Epoch 1018/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4588 - acc: 0.7763 - val_loss: 0.4865 - val_acc: 0.7913\n",
      "Epoch 1019/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4255 - acc: 0.8016 - val_loss: 0.4703 - val_acc: 0.7677\n",
      "Epoch 1020/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4277 - acc: 0.8054 - val_loss: 0.4685 - val_acc: 0.7717\n",
      "Epoch 1021/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4243 - acc: 0.7899 - val_loss: 0.5096 - val_acc: 0.7283\n",
      "Epoch 1022/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4189 - acc: 0.8035 - val_loss: 0.4924 - val_acc: 0.7913\n",
      "Epoch 1023/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4601 - acc: 0.7782 - val_loss: 0.4719 - val_acc: 0.7913\n",
      "Epoch 1024/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4580 - acc: 0.7840 - val_loss: 0.4907 - val_acc: 0.7402\n",
      "Epoch 1025/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4763 - acc: 0.7704 - val_loss: 0.4626 - val_acc: 0.8031\n",
      "Epoch 1026/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4752 - acc: 0.7626 - val_loss: 0.4665 - val_acc: 0.7953\n",
      "Epoch 1027/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4441 - acc: 0.7899 - val_loss: 0.5121 - val_acc: 0.7244\n",
      "Epoch 1028/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4472 - acc: 0.7607 - val_loss: 0.4717 - val_acc: 0.7874\n",
      "Epoch 1029/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4523 - acc: 0.7782 - val_loss: 0.4916 - val_acc: 0.7402\n",
      "Epoch 1030/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4431 - acc: 0.7840 - val_loss: 0.4719 - val_acc: 0.7835\n",
      "Epoch 1031/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4324 - acc: 0.8016 - val_loss: 0.4741 - val_acc: 0.7874\n",
      "Epoch 1032/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4352 - acc: 0.7938 - val_loss: 0.4803 - val_acc: 0.8031\n",
      "Epoch 1033/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4521 - acc: 0.7724 - val_loss: 0.4673 - val_acc: 0.7913\n",
      "Epoch 1034/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4711 - acc: 0.7821 - val_loss: 0.4992 - val_acc: 0.7520\n",
      "Epoch 1035/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4316 - acc: 0.8035 - val_loss: 0.4705 - val_acc: 0.7795\n",
      "Epoch 1036/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4281 - acc: 0.7957 - val_loss: 0.4676 - val_acc: 0.7756\n",
      "Epoch 1037/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4472 - acc: 0.7782 - val_loss: 0.4770 - val_acc: 0.7992\n",
      "Epoch 1038/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4457 - acc: 0.7938 - val_loss: 0.4762 - val_acc: 0.7717\n",
      "Epoch 1039/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4212 - acc: 0.8016 - val_loss: 0.4762 - val_acc: 0.7520\n",
      "Epoch 1040/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4290 - acc: 0.7957 - val_loss: 0.4749 - val_acc: 0.7835\n",
      "Epoch 1041/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4332 - acc: 0.7996 - val_loss: 0.4694 - val_acc: 0.7795\n",
      "Epoch 1042/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4232 - acc: 0.7957 - val_loss: 0.4826 - val_acc: 0.7598\n",
      "Epoch 1043/2000\n",
      "514/514 [==============================] - 0s 144us/step - loss: 0.4324 - acc: 0.7821 - val_loss: 0.4857 - val_acc: 0.7992\n",
      "Epoch 1044/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4413 - acc: 0.7860 - val_loss: 0.4858 - val_acc: 0.7953\n",
      "Epoch 1045/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4382 - acc: 0.7879 - val_loss: 0.4734 - val_acc: 0.7717\n",
      "Epoch 1046/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4254 - acc: 0.7879 - val_loss: 0.4781 - val_acc: 0.7559\n",
      "Epoch 1047/2000\n",
      "514/514 [==============================] - 0s 177us/step - loss: 0.4229 - acc: 0.7938 - val_loss: 0.4791 - val_acc: 0.7992\n",
      "Epoch 1048/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4295 - acc: 0.7957 - val_loss: 0.4747 - val_acc: 0.7638\n",
      "Epoch 1049/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4231 - acc: 0.7938 - val_loss: 0.4805 - val_acc: 0.7795\n",
      "Epoch 1050/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4340 - acc: 0.7802 - val_loss: 0.4836 - val_acc: 0.7953\n",
      "Epoch 1051/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4363 - acc: 0.7802 - val_loss: 0.4704 - val_acc: 0.7677\n",
      "Epoch 1052/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4204 - acc: 0.7879 - val_loss: 0.4812 - val_acc: 0.7677\n",
      "Epoch 1053/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4248 - acc: 0.7879 - val_loss: 0.5027 - val_acc: 0.7441\n",
      "Epoch 1054/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4576 - acc: 0.7899 - val_loss: 0.4904 - val_acc: 0.7638\n",
      "Epoch 1055/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4467 - acc: 0.7860 - val_loss: 0.4857 - val_acc: 0.7598\n",
      "Epoch 1056/2000\n",
      "514/514 [==============================] - 0s 162us/step - loss: 0.4241 - acc: 0.7918 - val_loss: 0.4820 - val_acc: 0.7559\n",
      "Epoch 1057/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4399 - acc: 0.7918 - val_loss: 0.5362 - val_acc: 0.7047\n",
      "Epoch 1058/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4587 - acc: 0.7724 - val_loss: 0.4850 - val_acc: 0.7480\n",
      "Epoch 1059/2000\n",
      "514/514 [==============================] - 0s 160us/step - loss: 0.4318 - acc: 0.7977 - val_loss: 0.4766 - val_acc: 0.7677\n",
      "Epoch 1060/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4246 - acc: 0.7938 - val_loss: 0.4824 - val_acc: 0.7402\n",
      "Epoch 1061/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.4473 - acc: 0.7743 - val_loss: 0.4672 - val_acc: 0.7953\n",
      "Epoch 1062/2000\n",
      "514/514 [==============================] - 0s 156us/step - loss: 0.4286 - acc: 0.7860 - val_loss: 0.4826 - val_acc: 0.7913\n",
      "Epoch 1063/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4352 - acc: 0.7918 - val_loss: 0.4837 - val_acc: 0.7677\n",
      "Epoch 1064/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 137us/step - loss: 0.4212 - acc: 0.8016 - val_loss: 0.4765 - val_acc: 0.7677\n",
      "Epoch 1065/2000\n",
      "514/514 [==============================] - 0s 136us/step - loss: 0.4208 - acc: 0.7860 - val_loss: 0.4743 - val_acc: 0.7717\n",
      "Epoch 1066/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4445 - acc: 0.7665 - val_loss: 0.4733 - val_acc: 0.7835\n",
      "Epoch 1067/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4369 - acc: 0.7918 - val_loss: 0.4972 - val_acc: 0.7559\n",
      "Epoch 1068/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4625 - acc: 0.7685 - val_loss: 0.4749 - val_acc: 0.7677\n",
      "Epoch 1069/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4343 - acc: 0.7802 - val_loss: 0.5003 - val_acc: 0.7953\n",
      "Epoch 1070/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4342 - acc: 0.7996 - val_loss: 0.4841 - val_acc: 0.7520\n",
      "Epoch 1071/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4354 - acc: 0.7763 - val_loss: 0.4950 - val_acc: 0.7598\n",
      "Epoch 1072/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4268 - acc: 0.7977 - val_loss: 0.4802 - val_acc: 0.7756\n",
      "Epoch 1073/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4800 - acc: 0.7607 - val_loss: 0.4753 - val_acc: 0.7913\n",
      "Epoch 1074/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4453 - acc: 0.7860 - val_loss: 0.4775 - val_acc: 0.7835\n",
      "Epoch 1075/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4293 - acc: 0.7957 - val_loss: 0.4775 - val_acc: 0.7598\n",
      "Epoch 1076/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4433 - acc: 0.7840 - val_loss: 0.4796 - val_acc: 0.7756\n",
      "Epoch 1077/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4253 - acc: 0.8113 - val_loss: 0.4726 - val_acc: 0.7717\n",
      "Epoch 1078/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4413 - acc: 0.7899 - val_loss: 0.4835 - val_acc: 0.7362\n",
      "Epoch 1079/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4594 - acc: 0.7879 - val_loss: 0.5148 - val_acc: 0.7913\n",
      "Epoch 1080/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4690 - acc: 0.7626 - val_loss: 0.4698 - val_acc: 0.7992\n",
      "Epoch 1081/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4587 - acc: 0.7724 - val_loss: 0.5073 - val_acc: 0.7441\n",
      "Epoch 1082/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4476 - acc: 0.7763 - val_loss: 0.4815 - val_acc: 0.7953\n",
      "Epoch 1083/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4287 - acc: 0.7860 - val_loss: 0.4736 - val_acc: 0.7717\n",
      "Epoch 1084/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4239 - acc: 0.7918 - val_loss: 0.4926 - val_acc: 0.7559\n",
      "Epoch 1085/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4568 - acc: 0.7704 - val_loss: 0.4713 - val_acc: 0.7874\n",
      "Epoch 1086/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4375 - acc: 0.7840 - val_loss: 0.4893 - val_acc: 0.7559\n",
      "Epoch 1087/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4350 - acc: 0.7899 - val_loss: 0.4696 - val_acc: 0.7717\n",
      "Epoch 1088/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4266 - acc: 0.7860 - val_loss: 0.4718 - val_acc: 0.7835\n",
      "Epoch 1089/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4393 - acc: 0.7763 - val_loss: 0.4815 - val_acc: 0.7441\n",
      "Epoch 1090/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4285 - acc: 0.8016 - val_loss: 0.4737 - val_acc: 0.7717\n",
      "Epoch 1091/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4272 - acc: 0.7996 - val_loss: 0.4789 - val_acc: 0.7677\n",
      "Epoch 1092/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4254 - acc: 0.7996 - val_loss: 0.4751 - val_acc: 0.7677\n",
      "Epoch 1093/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4241 - acc: 0.7996 - val_loss: 0.4778 - val_acc: 0.7717\n",
      "Epoch 1094/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4203 - acc: 0.7918 - val_loss: 0.4729 - val_acc: 0.7795\n",
      "Epoch 1095/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4191 - acc: 0.7938 - val_loss: 0.4803 - val_acc: 0.7874\n",
      "Epoch 1096/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4486 - acc: 0.7646 - val_loss: 0.4715 - val_acc: 0.7795\n",
      "Epoch 1097/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4375 - acc: 0.7821 - val_loss: 0.4884 - val_acc: 0.7992\n",
      "Epoch 1098/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4434 - acc: 0.7860 - val_loss: 0.5102 - val_acc: 0.7283\n",
      "Epoch 1099/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4325 - acc: 0.7704 - val_loss: 0.4763 - val_acc: 0.7717\n",
      "Epoch 1100/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4255 - acc: 0.7860 - val_loss: 0.4903 - val_acc: 0.7559\n",
      "Epoch 1101/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4263 - acc: 0.7918 - val_loss: 0.5031 - val_acc: 0.7441\n",
      "Epoch 1102/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4398 - acc: 0.7685 - val_loss: 0.4765 - val_acc: 0.7756\n",
      "Epoch 1103/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4296 - acc: 0.7957 - val_loss: 0.4889 - val_acc: 0.7874\n",
      "Epoch 1104/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4495 - acc: 0.7918 - val_loss: 0.4786 - val_acc: 0.7520\n",
      "Epoch 1105/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4544 - acc: 0.7743 - val_loss: 0.4902 - val_acc: 0.7913\n",
      "Epoch 1106/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4318 - acc: 0.7899 - val_loss: 0.4823 - val_acc: 0.7559\n",
      "Epoch 1107/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4418 - acc: 0.7840 - val_loss: 0.4733 - val_acc: 0.7717\n",
      "Epoch 1108/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4360 - acc: 0.7879 - val_loss: 0.5150 - val_acc: 0.7244\n",
      "Epoch 1109/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4496 - acc: 0.7704 - val_loss: 0.4963 - val_acc: 0.7520\n",
      "Epoch 1110/2000\n",
      "514/514 [==============================] - 0s 167us/step - loss: 0.4364 - acc: 0.8035 - val_loss: 0.5102 - val_acc: 0.7874\n",
      "Epoch 1111/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4615 - acc: 0.7607 - val_loss: 0.4733 - val_acc: 0.7756\n",
      "Epoch 1112/2000\n",
      "514/514 [==============================] - 0s 154us/step - loss: 0.4278 - acc: 0.7938 - val_loss: 0.4716 - val_acc: 0.7795\n",
      "Epoch 1113/2000\n",
      "514/514 [==============================] - 0s 139us/step - loss: 0.4323 - acc: 0.7879 - val_loss: 0.4810 - val_acc: 0.7638\n",
      "Epoch 1114/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4207 - acc: 0.8054 - val_loss: 0.4858 - val_acc: 0.7520\n",
      "Epoch 1115/2000\n",
      "514/514 [==============================] - 0s 194us/step - loss: 0.4579 - acc: 0.7802 - val_loss: 0.4850 - val_acc: 0.7953\n",
      "Epoch 1116/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4282 - acc: 0.7957 - val_loss: 0.4818 - val_acc: 0.7638\n",
      "Epoch 1117/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4728 - acc: 0.7471 - val_loss: 0.4911 - val_acc: 0.7874\n",
      "Epoch 1118/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.4409 - acc: 0.7977 - val_loss: 0.4714 - val_acc: 0.7835\n",
      "Epoch 1119/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4451 - acc: 0.7840 - val_loss: 0.5013 - val_acc: 0.7402\n",
      "Epoch 1120/2000\n",
      "514/514 [==============================] - 0s 139us/step - loss: 0.4272 - acc: 0.7977 - val_loss: 0.4733 - val_acc: 0.7835\n",
      "Epoch 1121/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4308 - acc: 0.7782 - val_loss: 0.4850 - val_acc: 0.7953\n",
      "Epoch 1122/2000\n",
      "514/514 [==============================] - 0s 143us/step - loss: 0.4354 - acc: 0.7957 - val_loss: 0.4863 - val_acc: 0.7480\n",
      "Epoch 1123/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 136us/step - loss: 0.4319 - acc: 0.7879 - val_loss: 0.4991 - val_acc: 0.7441\n",
      "Epoch 1124/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4212 - acc: 0.7802 - val_loss: 0.4798 - val_acc: 0.7835\n",
      "Epoch 1125/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4336 - acc: 0.7977 - val_loss: 0.4765 - val_acc: 0.7756\n",
      "Epoch 1126/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4280 - acc: 0.7996 - val_loss: 0.4837 - val_acc: 0.7441\n",
      "Epoch 1127/2000\n",
      "514/514 [==============================] - 0s 89us/step - loss: 0.4557 - acc: 0.7607 - val_loss: 0.4882 - val_acc: 0.7953\n",
      "Epoch 1128/2000\n",
      "514/514 [==============================] - 0s 82us/step - loss: 0.4303 - acc: 0.7821 - val_loss: 0.4768 - val_acc: 0.7677\n",
      "Epoch 1129/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4195 - acc: 0.7899 - val_loss: 0.4956 - val_acc: 0.7520\n",
      "Epoch 1130/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4245 - acc: 0.8054 - val_loss: 0.4927 - val_acc: 0.8031\n",
      "Epoch 1131/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4331 - acc: 0.7860 - val_loss: 0.4782 - val_acc: 0.7717\n",
      "Epoch 1132/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4249 - acc: 0.7840 - val_loss: 0.4848 - val_acc: 0.7756\n",
      "Epoch 1133/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4339 - acc: 0.7977 - val_loss: 0.4838 - val_acc: 0.7717\n",
      "Epoch 1134/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4217 - acc: 0.7957 - val_loss: 0.4855 - val_acc: 0.7559\n",
      "Epoch 1135/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4672 - acc: 0.7529 - val_loss: 0.4964 - val_acc: 0.7480\n",
      "Epoch 1136/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4516 - acc: 0.7646 - val_loss: 0.4849 - val_acc: 0.7677\n",
      "Epoch 1137/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4328 - acc: 0.7802 - val_loss: 0.4719 - val_acc: 0.7835\n",
      "Epoch 1138/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4245 - acc: 0.7938 - val_loss: 0.4752 - val_acc: 0.7795\n",
      "Epoch 1139/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4237 - acc: 0.7879 - val_loss: 0.4863 - val_acc: 0.7520\n",
      "Epoch 1140/2000\n",
      "514/514 [==============================] - 0s 89us/step - loss: 0.4503 - acc: 0.7879 - val_loss: 0.4736 - val_acc: 0.7795\n",
      "Epoch 1141/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4186 - acc: 0.8035 - val_loss: 0.4777 - val_acc: 0.7795\n",
      "Epoch 1142/2000\n",
      "514/514 [==============================] - 0s 90us/step - loss: 0.4352 - acc: 0.7996 - val_loss: 0.5027 - val_acc: 0.7402\n",
      "Epoch 1143/2000\n",
      "514/514 [==============================] - 0s 86us/step - loss: 0.4368 - acc: 0.7977 - val_loss: 0.4757 - val_acc: 0.7677\n",
      "Epoch 1144/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4229 - acc: 0.8054 - val_loss: 0.4769 - val_acc: 0.7638\n",
      "Epoch 1145/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4207 - acc: 0.7918 - val_loss: 0.4930 - val_acc: 0.7441\n",
      "Epoch 1146/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4273 - acc: 0.7821 - val_loss: 0.4806 - val_acc: 0.7638\n",
      "Epoch 1147/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4327 - acc: 0.7782 - val_loss: 0.4784 - val_acc: 0.7717\n",
      "Epoch 1148/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4254 - acc: 0.7938 - val_loss: 0.4748 - val_acc: 0.7638\n",
      "Epoch 1149/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4206 - acc: 0.7879 - val_loss: 0.5077 - val_acc: 0.7323\n",
      "Epoch 1150/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4334 - acc: 0.7996 - val_loss: 0.4829 - val_acc: 0.7992\n",
      "Epoch 1151/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4325 - acc: 0.7957 - val_loss: 0.4924 - val_acc: 0.7913\n",
      "Epoch 1152/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4336 - acc: 0.7860 - val_loss: 0.4856 - val_acc: 0.7402\n",
      "Epoch 1153/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4326 - acc: 0.8113 - val_loss: 0.4786 - val_acc: 0.7717\n",
      "Epoch 1154/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4349 - acc: 0.7743 - val_loss: 0.4711 - val_acc: 0.7756\n",
      "Epoch 1155/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4257 - acc: 0.7977 - val_loss: 0.4745 - val_acc: 0.7677\n",
      "Epoch 1156/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4298 - acc: 0.7996 - val_loss: 0.4787 - val_acc: 0.7756\n",
      "Epoch 1157/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4356 - acc: 0.7879 - val_loss: 0.4832 - val_acc: 0.7874\n",
      "Epoch 1158/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4199 - acc: 0.8016 - val_loss: 0.4784 - val_acc: 0.7756\n",
      "Epoch 1159/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4217 - acc: 0.7938 - val_loss: 0.4772 - val_acc: 0.7638\n",
      "Epoch 1160/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4177 - acc: 0.8016 - val_loss: 0.4784 - val_acc: 0.7598\n",
      "Epoch 1161/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4203 - acc: 0.7860 - val_loss: 0.4779 - val_acc: 0.7756\n",
      "Epoch 1162/2000\n",
      "514/514 [==============================] - 0s 424us/step - loss: 0.4429 - acc: 0.7840 - val_loss: 0.4804 - val_acc: 0.7756\n",
      "Epoch 1163/2000\n",
      "514/514 [==============================] - 0s 186us/step - loss: 0.4645 - acc: 0.7899 - val_loss: 0.5190 - val_acc: 0.7244\n",
      "Epoch 1164/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4696 - acc: 0.7685 - val_loss: 0.4763 - val_acc: 0.7913\n",
      "Epoch 1165/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4216 - acc: 0.7860 - val_loss: 0.4798 - val_acc: 0.7559\n",
      "Epoch 1166/2000\n",
      "514/514 [==============================] - 0s 157us/step - loss: 0.4208 - acc: 0.8016 - val_loss: 0.4751 - val_acc: 0.7598\n",
      "Epoch 1167/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4291 - acc: 0.7977 - val_loss: 0.4748 - val_acc: 0.7559\n",
      "Epoch 1168/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4393 - acc: 0.7743 - val_loss: 0.4884 - val_acc: 0.7441\n",
      "Epoch 1169/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4302 - acc: 0.7840 - val_loss: 0.4917 - val_acc: 0.7598\n",
      "Epoch 1170/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4298 - acc: 0.7899 - val_loss: 0.4763 - val_acc: 0.7756\n",
      "Epoch 1171/2000\n",
      "514/514 [==============================] - 0s 136us/step - loss: 0.4250 - acc: 0.7918 - val_loss: 0.4729 - val_acc: 0.7795\n",
      "Epoch 1172/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4357 - acc: 0.7743 - val_loss: 0.4716 - val_acc: 0.7677\n",
      "Epoch 1173/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4312 - acc: 0.7938 - val_loss: 0.4792 - val_acc: 0.7756\n",
      "Epoch 1174/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4269 - acc: 0.7821 - val_loss: 0.4776 - val_acc: 0.7717\n",
      "Epoch 1175/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4191 - acc: 0.7918 - val_loss: 0.5269 - val_acc: 0.7126\n",
      "Epoch 1176/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.5155 - acc: 0.7121 - val_loss: 0.5020 - val_acc: 0.7874\n",
      "Epoch 1177/2000\n",
      "514/514 [==============================] - 0s 271us/step - loss: 0.4634 - acc: 0.7685 - val_loss: 0.4806 - val_acc: 0.7559\n",
      "Epoch 1178/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4385 - acc: 0.7918 - val_loss: 0.4850 - val_acc: 0.7480\n",
      "Epoch 1179/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4362 - acc: 0.7918 - val_loss: 0.5090 - val_acc: 0.7874\n",
      "Epoch 1180/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4582 - acc: 0.7860 - val_loss: 0.4813 - val_acc: 0.7441\n",
      "Epoch 1181/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4338 - acc: 0.7977 - val_loss: 0.4941 - val_acc: 0.7402\n",
      "Epoch 1182/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4438 - acc: 0.7665 - val_loss: 0.4733 - val_acc: 0.7992\n",
      "Epoch 1183/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4208 - acc: 0.7860 - val_loss: 0.4736 - val_acc: 0.7677\n",
      "Epoch 1184/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4191 - acc: 0.7996 - val_loss: 0.4758 - val_acc: 0.7953\n",
      "Epoch 1185/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4374 - acc: 0.7899 - val_loss: 0.4775 - val_acc: 0.7520\n",
      "Epoch 1186/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4205 - acc: 0.7918 - val_loss: 0.4739 - val_acc: 0.7756\n",
      "Epoch 1187/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4211 - acc: 0.7899 - val_loss: 0.4771 - val_acc: 0.7559\n",
      "Epoch 1188/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4325 - acc: 0.7899 - val_loss: 0.4783 - val_acc: 0.7598\n",
      "Epoch 1189/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4244 - acc: 0.7938 - val_loss: 0.4790 - val_acc: 0.7559\n",
      "Epoch 1190/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4221 - acc: 0.7918 - val_loss: 0.4803 - val_acc: 0.7480\n",
      "Epoch 1191/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4841 - acc: 0.7665 - val_loss: 0.4731 - val_acc: 0.7677\n",
      "Epoch 1192/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4328 - acc: 0.7938 - val_loss: 0.4854 - val_acc: 0.7953\n",
      "Epoch 1193/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4195 - acc: 0.7899 - val_loss: 0.4799 - val_acc: 0.7756\n",
      "Epoch 1194/2000\n",
      "514/514 [==============================] - 0s 136us/step - loss: 0.4278 - acc: 0.7977 - val_loss: 0.4796 - val_acc: 0.7835\n",
      "Epoch 1195/2000\n",
      "514/514 [==============================] - 0s 154us/step - loss: 0.4205 - acc: 0.7957 - val_loss: 0.4784 - val_acc: 0.7756\n",
      "Epoch 1196/2000\n",
      "514/514 [==============================] - 0s 171us/step - loss: 0.4236 - acc: 0.7802 - val_loss: 0.4781 - val_acc: 0.7598\n",
      "Epoch 1197/2000\n",
      "514/514 [==============================] - 0s 89us/step - loss: 0.4353 - acc: 0.7938 - val_loss: 0.4813 - val_acc: 0.7559\n",
      "Epoch 1198/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4190 - acc: 0.8016 - val_loss: 0.4898 - val_acc: 0.7520\n",
      "Epoch 1199/2000\n",
      "514/514 [==============================] - 0s 136us/step - loss: 0.4219 - acc: 0.7938 - val_loss: 0.4839 - val_acc: 0.7559\n",
      "Epoch 1200/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4199 - acc: 0.7918 - val_loss: 0.4810 - val_acc: 0.7559\n",
      "Epoch 1201/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4159 - acc: 0.8016 - val_loss: 0.4877 - val_acc: 0.7756\n",
      "Epoch 1202/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4181 - acc: 0.7957 - val_loss: 0.4822 - val_acc: 0.7638\n",
      "Epoch 1203/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4387 - acc: 0.7938 - val_loss: 0.4826 - val_acc: 0.7520\n",
      "Epoch 1204/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4414 - acc: 0.7821 - val_loss: 0.4950 - val_acc: 0.7559\n",
      "Epoch 1205/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4240 - acc: 0.7840 - val_loss: 0.4772 - val_acc: 0.7717\n",
      "Epoch 1206/2000\n",
      "514/514 [==============================] - 0s 90us/step - loss: 0.4236 - acc: 0.8016 - val_loss: 0.4804 - val_acc: 0.7598\n",
      "Epoch 1207/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4338 - acc: 0.7899 - val_loss: 0.4926 - val_acc: 0.7520\n",
      "Epoch 1208/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4284 - acc: 0.7996 - val_loss: 0.4796 - val_acc: 0.7638\n",
      "Epoch 1209/2000\n",
      "514/514 [==============================] - 0s 183us/step - loss: 0.4326 - acc: 0.7938 - val_loss: 0.4767 - val_acc: 0.7638\n",
      "Epoch 1210/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4294 - acc: 0.7802 - val_loss: 0.4813 - val_acc: 0.7520\n",
      "Epoch 1211/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4215 - acc: 0.7899 - val_loss: 0.4813 - val_acc: 0.7559\n",
      "Epoch 1212/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4300 - acc: 0.7860 - val_loss: 0.4832 - val_acc: 0.7992\n",
      "Epoch 1213/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4250 - acc: 0.7938 - val_loss: 0.4899 - val_acc: 0.7874\n",
      "Epoch 1214/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4612 - acc: 0.7626 - val_loss: 0.4744 - val_acc: 0.7717\n",
      "Epoch 1215/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4390 - acc: 0.7802 - val_loss: 0.5107 - val_acc: 0.7283\n",
      "Epoch 1216/2000\n",
      "514/514 [==============================] - 0s 225us/step - loss: 0.4844 - acc: 0.7490 - val_loss: 0.5301 - val_acc: 0.7835\n",
      "Epoch 1217/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4675 - acc: 0.7743 - val_loss: 0.5070 - val_acc: 0.7362\n",
      "Epoch 1218/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4434 - acc: 0.8074 - val_loss: 0.4817 - val_acc: 0.7874\n",
      "Epoch 1219/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4287 - acc: 0.7977 - val_loss: 0.4808 - val_acc: 0.7992\n",
      "Epoch 1220/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4163 - acc: 0.7899 - val_loss: 0.4957 - val_acc: 0.7559\n",
      "Epoch 1221/2000\n",
      "514/514 [==============================] - 0s 188us/step - loss: 0.4303 - acc: 0.8035 - val_loss: 0.4887 - val_acc: 0.7441\n",
      "Epoch 1222/2000\n",
      "514/514 [==============================] - 0s 177us/step - loss: 0.5084 - acc: 0.7354 - val_loss: 0.4833 - val_acc: 0.7992\n",
      "Epoch 1223/2000\n",
      "514/514 [==============================] - 0s 154us/step - loss: 0.4291 - acc: 0.7918 - val_loss: 0.5044 - val_acc: 0.7362\n",
      "Epoch 1224/2000\n",
      "514/514 [==============================] - 0s 182us/step - loss: 0.4596 - acc: 0.7607 - val_loss: 0.4782 - val_acc: 0.7835\n",
      "Epoch 1225/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4371 - acc: 0.7782 - val_loss: 0.4867 - val_acc: 0.7992\n",
      "Epoch 1226/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4249 - acc: 0.7938 - val_loss: 0.4805 - val_acc: 0.7717\n",
      "Epoch 1227/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4200 - acc: 0.7918 - val_loss: 0.4928 - val_acc: 0.7953\n",
      "Epoch 1228/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4238 - acc: 0.8016 - val_loss: 0.4846 - val_acc: 0.7520\n",
      "Epoch 1229/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4337 - acc: 0.7763 - val_loss: 0.5016 - val_acc: 0.7402\n",
      "Epoch 1230/2000\n",
      "514/514 [==============================] - 0s 182us/step - loss: 0.4356 - acc: 0.8074 - val_loss: 0.4881 - val_acc: 0.7874\n",
      "Epoch 1231/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4192 - acc: 0.8074 - val_loss: 0.4837 - val_acc: 0.7638\n",
      "Epoch 1232/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4115 - acc: 0.8016 - val_loss: 0.4967 - val_acc: 0.7559\n",
      "Epoch 1233/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4428 - acc: 0.7821 - val_loss: 0.4861 - val_acc: 0.7795\n",
      "Epoch 1234/2000\n",
      "514/514 [==============================] - 0s 154us/step - loss: 0.4191 - acc: 0.7996 - val_loss: 0.4857 - val_acc: 0.7559\n",
      "Epoch 1235/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4145 - acc: 0.8016 - val_loss: 0.4934 - val_acc: 0.7638\n",
      "Epoch 1236/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4256 - acc: 0.8035 - val_loss: 0.4953 - val_acc: 0.7638\n",
      "Epoch 1237/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4222 - acc: 0.7918 - val_loss: 0.4861 - val_acc: 0.7677\n",
      "Epoch 1238/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4157 - acc: 0.7899 - val_loss: 0.4876 - val_acc: 0.7402\n",
      "Epoch 1239/2000\n",
      "514/514 [==============================] - 0s 210us/step - loss: 0.4382 - acc: 0.7821 - val_loss: 0.4966 - val_acc: 0.7520\n",
      "Epoch 1240/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4287 - acc: 0.7918 - val_loss: 0.4819 - val_acc: 0.7835\n",
      "Epoch 1241/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 185us/step - loss: 0.4349 - acc: 0.7918 - val_loss: 0.4800 - val_acc: 0.7874\n",
      "Epoch 1242/2000\n",
      "514/514 [==============================] - 0s 79us/step - loss: 0.4200 - acc: 0.7957 - val_loss: 0.5019 - val_acc: 0.7480\n",
      "Epoch 1243/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4277 - acc: 0.7996 - val_loss: 0.4903 - val_acc: 0.7520\n",
      "Epoch 1244/2000\n",
      "514/514 [==============================] - 0s 89us/step - loss: 0.4558 - acc: 0.7607 - val_loss: 0.5177 - val_acc: 0.7874\n",
      "Epoch 1245/2000\n",
      "514/514 [==============================] - 0s 92us/step - loss: 0.4455 - acc: 0.7840 - val_loss: 0.4889 - val_acc: 0.7717\n",
      "Epoch 1246/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4213 - acc: 0.7977 - val_loss: 0.4815 - val_acc: 0.7874\n",
      "Epoch 1247/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4280 - acc: 0.8035 - val_loss: 0.4822 - val_acc: 0.7638\n",
      "Epoch 1248/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.5003 - acc: 0.7471 - val_loss: 0.4956 - val_acc: 0.7953\n",
      "Epoch 1249/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4336 - acc: 0.7957 - val_loss: 0.4744 - val_acc: 0.7874\n",
      "Epoch 1250/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4461 - acc: 0.7743 - val_loss: 0.4769 - val_acc: 0.7795\n",
      "Epoch 1251/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4362 - acc: 0.7957 - val_loss: 0.4852 - val_acc: 0.7913\n",
      "Epoch 1252/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4382 - acc: 0.7938 - val_loss: 0.4822 - val_acc: 0.7638\n",
      "Epoch 1253/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4470 - acc: 0.7724 - val_loss: 0.4844 - val_acc: 0.7677\n",
      "Epoch 1254/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4254 - acc: 0.7957 - val_loss: 0.4877 - val_acc: 0.7953\n",
      "Epoch 1255/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4292 - acc: 0.7918 - val_loss: 0.4785 - val_acc: 0.7598\n",
      "Epoch 1256/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4731 - acc: 0.7665 - val_loss: 0.4887 - val_acc: 0.7874\n",
      "Epoch 1257/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4299 - acc: 0.8016 - val_loss: 0.4903 - val_acc: 0.7598\n",
      "Epoch 1258/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4305 - acc: 0.7918 - val_loss: 0.4838 - val_acc: 0.7835\n",
      "Epoch 1259/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4197 - acc: 0.7977 - val_loss: 0.4831 - val_acc: 0.7874\n",
      "Epoch 1260/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4143 - acc: 0.7899 - val_loss: 0.4806 - val_acc: 0.7756\n",
      "Epoch 1261/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4182 - acc: 0.7977 - val_loss: 0.4819 - val_acc: 0.7598\n",
      "Epoch 1262/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4225 - acc: 0.7957 - val_loss: 0.4822 - val_acc: 0.7677\n",
      "Epoch 1263/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4392 - acc: 0.7977 - val_loss: 0.4825 - val_acc: 0.7874\n",
      "Epoch 1264/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4250 - acc: 0.7899 - val_loss: 0.4850 - val_acc: 0.7638\n",
      "Epoch 1265/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4393 - acc: 0.7957 - val_loss: 0.4882 - val_acc: 0.7795\n",
      "Epoch 1266/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4489 - acc: 0.7743 - val_loss: 0.4981 - val_acc: 0.7362\n",
      "Epoch 1267/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4367 - acc: 0.7879 - val_loss: 0.4798 - val_acc: 0.7874\n",
      "Epoch 1268/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4222 - acc: 0.7860 - val_loss: 0.4761 - val_acc: 0.7756\n",
      "Epoch 1269/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4243 - acc: 0.7899 - val_loss: 0.4770 - val_acc: 0.7677\n",
      "Epoch 1270/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4212 - acc: 0.7918 - val_loss: 0.4804 - val_acc: 0.7717\n",
      "Epoch 1271/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4256 - acc: 0.7918 - val_loss: 0.4804 - val_acc: 0.7756\n",
      "Epoch 1272/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4203 - acc: 0.7938 - val_loss: 0.4757 - val_acc: 0.7835\n",
      "Epoch 1273/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4188 - acc: 0.7977 - val_loss: 0.4825 - val_acc: 0.7717\n",
      "Epoch 1274/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4140 - acc: 0.7879 - val_loss: 0.4874 - val_acc: 0.7480\n",
      "Epoch 1275/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4272 - acc: 0.7918 - val_loss: 0.5045 - val_acc: 0.7362\n",
      "Epoch 1276/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4262 - acc: 0.7899 - val_loss: 0.4906 - val_acc: 0.7795\n",
      "Epoch 1277/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4612 - acc: 0.7665 - val_loss: 0.5129 - val_acc: 0.7717\n",
      "Epoch 1278/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4286 - acc: 0.7704 - val_loss: 0.4773 - val_acc: 0.7598\n",
      "Epoch 1279/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4480 - acc: 0.7899 - val_loss: 0.4849 - val_acc: 0.7756\n",
      "Epoch 1280/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4477 - acc: 0.7918 - val_loss: 0.5100 - val_acc: 0.7323\n",
      "Epoch 1281/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4387 - acc: 0.7957 - val_loss: 0.4772 - val_acc: 0.7874\n",
      "Epoch 1282/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4233 - acc: 0.7957 - val_loss: 0.4818 - val_acc: 0.7756\n",
      "Epoch 1283/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4177 - acc: 0.8093 - val_loss: 0.4809 - val_acc: 0.7835\n",
      "Epoch 1284/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4194 - acc: 0.8054 - val_loss: 0.4838 - val_acc: 0.7835\n",
      "Epoch 1285/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4165 - acc: 0.7918 - val_loss: 0.4890 - val_acc: 0.7717\n",
      "Epoch 1286/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4283 - acc: 0.7938 - val_loss: 0.4839 - val_acc: 0.7717\n",
      "Epoch 1287/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4197 - acc: 0.7860 - val_loss: 0.4833 - val_acc: 0.7559\n",
      "Epoch 1288/2000\n",
      "514/514 [==============================] - 0s 140us/step - loss: 0.4403 - acc: 0.7918 - val_loss: 0.4847 - val_acc: 0.7953\n",
      "Epoch 1289/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4312 - acc: 0.7860 - val_loss: 0.4869 - val_acc: 0.7756\n",
      "Epoch 1290/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4227 - acc: 0.7918 - val_loss: 0.4869 - val_acc: 0.7520\n",
      "Epoch 1291/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4174 - acc: 0.7996 - val_loss: 0.4901 - val_acc: 0.7480\n",
      "Epoch 1292/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4217 - acc: 0.7860 - val_loss: 0.4891 - val_acc: 0.7598\n",
      "Epoch 1293/2000\n",
      "514/514 [==============================] - 0s 167us/step - loss: 0.4309 - acc: 0.7802 - val_loss: 0.4965 - val_acc: 0.7441\n",
      "Epoch 1294/2000\n",
      "514/514 [==============================] - 0s 137us/step - loss: 0.4310 - acc: 0.7899 - val_loss: 0.4933 - val_acc: 0.7520\n",
      "Epoch 1295/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4235 - acc: 0.7879 - val_loss: 0.4872 - val_acc: 0.7598\n",
      "Epoch 1296/2000\n",
      "514/514 [==============================] - 0s 206us/step - loss: 0.4142 - acc: 0.7996 - val_loss: 0.4892 - val_acc: 0.7598\n",
      "Epoch 1297/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4156 - acc: 0.8016 - val_loss: 0.4892 - val_acc: 0.7520\n",
      "Epoch 1298/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4182 - acc: 0.7899 - val_loss: 0.4909 - val_acc: 0.7441\n",
      "Epoch 1299/2000\n",
      "514/514 [==============================] - 0s 140us/step - loss: 0.4152 - acc: 0.8016 - val_loss: 0.4911 - val_acc: 0.7598\n",
      "Epoch 1300/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4256 - acc: 0.7743 - val_loss: 0.4878 - val_acc: 0.7638\n",
      "Epoch 1301/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4134 - acc: 0.7918 - val_loss: 0.4872 - val_acc: 0.7559\n",
      "Epoch 1302/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4141 - acc: 0.8035 - val_loss: 0.5205 - val_acc: 0.7205\n",
      "Epoch 1303/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.5249 - acc: 0.7374 - val_loss: 0.5132 - val_acc: 0.7756\n",
      "Epoch 1304/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4646 - acc: 0.7879 - val_loss: 0.4735 - val_acc: 0.7756\n",
      "Epoch 1305/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4314 - acc: 0.7918 - val_loss: 0.4736 - val_acc: 0.7835\n",
      "Epoch 1306/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4253 - acc: 0.7879 - val_loss: 0.4755 - val_acc: 0.7598\n",
      "Epoch 1307/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4213 - acc: 0.7938 - val_loss: 0.4800 - val_acc: 0.7795\n",
      "Epoch 1308/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4229 - acc: 0.7957 - val_loss: 0.4787 - val_acc: 0.7638\n",
      "Epoch 1309/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4168 - acc: 0.8016 - val_loss: 0.4831 - val_acc: 0.7756\n",
      "Epoch 1310/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4194 - acc: 0.7879 - val_loss: 0.4845 - val_acc: 0.7756\n",
      "Epoch 1311/2000\n",
      "514/514 [==============================] - 0s 87us/step - loss: 0.4182 - acc: 0.7879 - val_loss: 0.4895 - val_acc: 0.7835\n",
      "Epoch 1312/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4344 - acc: 0.7821 - val_loss: 0.4981 - val_acc: 0.7953\n",
      "Epoch 1313/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4564 - acc: 0.8016 - val_loss: 0.4943 - val_acc: 0.7480\n",
      "Epoch 1314/2000\n",
      "514/514 [==============================] - 0s 154us/step - loss: 0.4229 - acc: 0.7938 - val_loss: 0.4825 - val_acc: 0.7480\n",
      "Epoch 1315/2000\n",
      "514/514 [==============================] - 0s 164us/step - loss: 0.4117 - acc: 0.7996 - val_loss: 0.5357 - val_acc: 0.7992\n",
      "Epoch 1316/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4772 - acc: 0.7840 - val_loss: 0.4815 - val_acc: 0.7795\n",
      "Epoch 1317/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4480 - acc: 0.7918 - val_loss: 0.4822 - val_acc: 0.7598\n",
      "Epoch 1318/2000\n",
      "514/514 [==============================] - 0s 185us/step - loss: 0.4293 - acc: 0.7840 - val_loss: 0.4788 - val_acc: 0.7638\n",
      "Epoch 1319/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4206 - acc: 0.7977 - val_loss: 0.4846 - val_acc: 0.7559\n",
      "Epoch 1320/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4287 - acc: 0.7957 - val_loss: 0.4804 - val_acc: 0.7795\n",
      "Epoch 1321/2000\n",
      "514/514 [==============================] - 0s 136us/step - loss: 0.4238 - acc: 0.7996 - val_loss: 0.4800 - val_acc: 0.7795\n",
      "Epoch 1322/2000\n",
      "514/514 [==============================] - 0s 254us/step - loss: 0.4156 - acc: 0.7977 - val_loss: 0.4817 - val_acc: 0.7677\n",
      "Epoch 1323/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4122 - acc: 0.7918 - val_loss: 0.4815 - val_acc: 0.7677\n",
      "Epoch 1324/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4153 - acc: 0.7938 - val_loss: 0.4885 - val_acc: 0.7598\n",
      "Epoch 1325/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4209 - acc: 0.8035 - val_loss: 0.4880 - val_acc: 0.7559\n",
      "Epoch 1326/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4143 - acc: 0.7996 - val_loss: 0.5031 - val_acc: 0.7992\n",
      "Epoch 1327/2000\n",
      "514/514 [==============================] - 0s 142us/step - loss: 0.4362 - acc: 0.7977 - val_loss: 0.4807 - val_acc: 0.7677\n",
      "Epoch 1328/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4244 - acc: 0.7977 - val_loss: 0.4872 - val_acc: 0.7520\n",
      "Epoch 1329/2000\n",
      "514/514 [==============================] - 0s 157us/step - loss: 0.4130 - acc: 0.7938 - val_loss: 0.4843 - val_acc: 0.7638\n",
      "Epoch 1330/2000\n",
      "514/514 [==============================] - 0s 144us/step - loss: 0.4176 - acc: 0.7918 - val_loss: 0.4889 - val_acc: 0.7480\n",
      "Epoch 1331/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4184 - acc: 0.7840 - val_loss: 0.5057 - val_acc: 0.7323\n",
      "Epoch 1332/2000\n",
      "514/514 [==============================] - 0s 197us/step - loss: 0.4733 - acc: 0.7704 - val_loss: 0.4871 - val_acc: 0.7874\n",
      "Epoch 1333/2000\n",
      "514/514 [==============================] - 0s 204us/step - loss: 0.4432 - acc: 0.7860 - val_loss: 0.4852 - val_acc: 0.7441\n",
      "Epoch 1334/2000\n",
      "514/514 [==============================] - 0s 160us/step - loss: 0.4395 - acc: 0.7957 - val_loss: 0.4952 - val_acc: 0.7559\n",
      "Epoch 1335/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4340 - acc: 0.7879 - val_loss: 0.4849 - val_acc: 0.7638\n",
      "Epoch 1336/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4136 - acc: 0.7977 - val_loss: 0.4899 - val_acc: 0.7559\n",
      "Epoch 1337/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4130 - acc: 0.8074 - val_loss: 0.5107 - val_acc: 0.7323\n",
      "Epoch 1338/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4180 - acc: 0.7938 - val_loss: 0.4893 - val_acc: 0.7638\n",
      "Epoch 1339/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4274 - acc: 0.7840 - val_loss: 0.4972 - val_acc: 0.7874\n",
      "Epoch 1340/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4112 - acc: 0.7840 - val_loss: 0.5165 - val_acc: 0.7205\n",
      "Epoch 1341/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.5061 - acc: 0.7296 - val_loss: 0.5014 - val_acc: 0.7677\n",
      "Epoch 1342/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4722 - acc: 0.7490 - val_loss: 0.4950 - val_acc: 0.7480\n",
      "Epoch 1343/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4612 - acc: 0.7549 - val_loss: 0.4874 - val_acc: 0.7638\n",
      "Epoch 1344/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4593 - acc: 0.7626 - val_loss: 0.4820 - val_acc: 0.7717\n",
      "Epoch 1345/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4533 - acc: 0.7685 - val_loss: 0.4870 - val_acc: 0.7598\n",
      "Epoch 1346/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4608 - acc: 0.7685 - val_loss: 0.4803 - val_acc: 0.7717\n",
      "Epoch 1347/2000\n",
      "514/514 [==============================] - 0s 216us/step - loss: 0.4548 - acc: 0.7568 - val_loss: 0.4805 - val_acc: 0.7559\n",
      "Epoch 1348/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4533 - acc: 0.7763 - val_loss: 0.4787 - val_acc: 0.7953\n",
      "Epoch 1349/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4493 - acc: 0.7763 - val_loss: 0.4748 - val_acc: 0.7795\n",
      "Epoch 1350/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.4481 - acc: 0.7665 - val_loss: 0.4774 - val_acc: 0.7756\n",
      "Epoch 1351/2000\n",
      "514/514 [==============================] - 0s 62us/step - loss: 0.4569 - acc: 0.7782 - val_loss: 0.4849 - val_acc: 0.7913\n",
      "Epoch 1352/2000\n",
      "514/514 [==============================] - 0s 291us/step - loss: 0.4641 - acc: 0.7588 - val_loss: 0.4805 - val_acc: 0.7756\n",
      "Epoch 1353/2000\n",
      "514/514 [==============================] - 0s 143us/step - loss: 0.4726 - acc: 0.7568 - val_loss: 0.4771 - val_acc: 0.7638\n",
      "Epoch 1354/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4777 - acc: 0.7568 - val_loss: 0.5078 - val_acc: 0.7126\n",
      "Epoch 1355/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4601 - acc: 0.7763 - val_loss: 0.4744 - val_acc: 0.7717\n",
      "Epoch 1356/2000\n",
      "514/514 [==============================] - 0s 192us/step - loss: 0.4459 - acc: 0.7626 - val_loss: 0.4750 - val_acc: 0.7638\n",
      "Epoch 1357/2000\n",
      "514/514 [==============================] - 0s 261us/step - loss: 0.4494 - acc: 0.7782 - val_loss: 0.4721 - val_acc: 0.7795\n",
      "Epoch 1358/2000\n",
      "514/514 [==============================] - 0s 283us/step - loss: 0.4427 - acc: 0.7763 - val_loss: 0.4700 - val_acc: 0.7874\n",
      "Epoch 1359/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 335us/step - loss: 0.4432 - acc: 0.7782 - val_loss: 0.4704 - val_acc: 0.7874\n",
      "Epoch 1360/2000\n",
      "514/514 [==============================] - 0s 178us/step - loss: 0.4477 - acc: 0.7821 - val_loss: 0.4944 - val_acc: 0.7402\n",
      "Epoch 1361/2000\n",
      "514/514 [==============================] - 0s 143us/step - loss: 0.4556 - acc: 0.7588 - val_loss: 0.4749 - val_acc: 0.7835\n",
      "Epoch 1362/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4466 - acc: 0.7840 - val_loss: 0.4737 - val_acc: 0.7795\n",
      "Epoch 1363/2000\n",
      "514/514 [==============================] - 0s 87us/step - loss: 0.4549 - acc: 0.7665 - val_loss: 0.4773 - val_acc: 0.7559\n",
      "Epoch 1364/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4388 - acc: 0.7879 - val_loss: 0.4964 - val_acc: 0.7953\n",
      "Epoch 1365/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4876 - acc: 0.7802 - val_loss: 0.5067 - val_acc: 0.7283\n",
      "Epoch 1366/2000\n",
      "514/514 [==============================] - 0s 78us/step - loss: 0.4378 - acc: 0.7860 - val_loss: 0.4862 - val_acc: 0.7874\n",
      "Epoch 1367/2000\n",
      "514/514 [==============================] - 0s 77us/step - loss: 0.4634 - acc: 0.7879 - val_loss: 0.4935 - val_acc: 0.7362\n",
      "Epoch 1368/2000\n",
      "514/514 [==============================] - 0s 79us/step - loss: 0.4524 - acc: 0.7918 - val_loss: 0.5004 - val_acc: 0.7402\n",
      "Epoch 1369/2000\n",
      "514/514 [==============================] - 0s 84us/step - loss: 0.4534 - acc: 0.7626 - val_loss: 0.4730 - val_acc: 0.7677\n",
      "Epoch 1370/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4424 - acc: 0.7899 - val_loss: 0.4716 - val_acc: 0.7835\n",
      "Epoch 1371/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4404 - acc: 0.7821 - val_loss: 0.4929 - val_acc: 0.7244\n",
      "Epoch 1372/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4637 - acc: 0.7626 - val_loss: 0.4766 - val_acc: 0.7638\n",
      "Epoch 1373/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4432 - acc: 0.7957 - val_loss: 0.4742 - val_acc: 0.7795\n",
      "Epoch 1374/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4486 - acc: 0.7840 - val_loss: 0.4791 - val_acc: 0.7559\n",
      "Epoch 1375/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4414 - acc: 0.7879 - val_loss: 0.4946 - val_acc: 0.7323\n",
      "Epoch 1376/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4476 - acc: 0.7860 - val_loss: 0.4733 - val_acc: 0.7913\n",
      "Epoch 1377/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4381 - acc: 0.7899 - val_loss: 0.4775 - val_acc: 0.7598\n",
      "Epoch 1378/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4404 - acc: 0.7860 - val_loss: 0.4753 - val_acc: 0.7835\n",
      "Epoch 1379/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4331 - acc: 0.7879 - val_loss: 0.4877 - val_acc: 0.7598\n",
      "Epoch 1380/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4437 - acc: 0.7685 - val_loss: 0.4717 - val_acc: 0.7835\n",
      "Epoch 1381/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4381 - acc: 0.7899 - val_loss: 0.4719 - val_acc: 0.7795\n",
      "Epoch 1382/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4394 - acc: 0.7840 - val_loss: 0.4726 - val_acc: 0.7913\n",
      "Epoch 1383/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4348 - acc: 0.7821 - val_loss: 0.4909 - val_acc: 0.7520\n",
      "Epoch 1384/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4408 - acc: 0.7899 - val_loss: 0.4921 - val_acc: 0.7441\n",
      "Epoch 1385/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4679 - acc: 0.7782 - val_loss: 0.4863 - val_acc: 0.7835\n",
      "Epoch 1386/2000\n",
      "514/514 [==============================] - 0s 197us/step - loss: 0.4599 - acc: 0.7763 - val_loss: 0.4848 - val_acc: 0.7559\n",
      "Epoch 1387/2000\n",
      "514/514 [==============================] - 0s 259us/step - loss: 0.4368 - acc: 0.7899 - val_loss: 0.4742 - val_acc: 0.7835\n",
      "Epoch 1388/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4322 - acc: 0.7840 - val_loss: 0.4776 - val_acc: 0.7598\n",
      "Epoch 1389/2000\n",
      "514/514 [==============================] - 0s 154us/step - loss: 0.4339 - acc: 0.7879 - val_loss: 0.4694 - val_acc: 0.7874\n",
      "Epoch 1390/2000\n",
      "514/514 [==============================] - 0s 137us/step - loss: 0.4416 - acc: 0.7782 - val_loss: 0.4836 - val_acc: 0.7874\n",
      "Epoch 1391/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4742 - acc: 0.7802 - val_loss: 0.4715 - val_acc: 0.7480\n",
      "Epoch 1392/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4347 - acc: 0.7821 - val_loss: 0.4661 - val_acc: 0.7835\n",
      "Epoch 1393/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4301 - acc: 0.7879 - val_loss: 0.4794 - val_acc: 0.7756\n",
      "Epoch 1394/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4300 - acc: 0.7957 - val_loss: 0.4773 - val_acc: 0.7874\n",
      "Epoch 1395/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4520 - acc: 0.7802 - val_loss: 0.4657 - val_acc: 0.7756\n",
      "Epoch 1396/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4373 - acc: 0.7743 - val_loss: 0.4927 - val_acc: 0.7402\n",
      "Epoch 1397/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4555 - acc: 0.7685 - val_loss: 0.5131 - val_acc: 0.7795\n",
      "Epoch 1398/2000\n",
      "514/514 [==============================] - 0s 140us/step - loss: 0.4706 - acc: 0.7821 - val_loss: 0.4849 - val_acc: 0.7480\n",
      "Epoch 1399/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4403 - acc: 0.7860 - val_loss: 0.4674 - val_acc: 0.7874\n",
      "Epoch 1400/2000\n",
      "514/514 [==============================] - 0s 451us/step - loss: 0.4329 - acc: 0.7821 - val_loss: 0.4658 - val_acc: 0.7795\n",
      "Epoch 1401/2000\n",
      "514/514 [==============================] - 0s 730us/step - loss: 0.4320 - acc: 0.7821 - val_loss: 0.4691 - val_acc: 0.7835\n",
      "Epoch 1402/2000\n",
      "514/514 [==============================] - 0s 343us/step - loss: 0.4293 - acc: 0.7918 - val_loss: 0.4735 - val_acc: 0.7677\n",
      "Epoch 1403/2000\n",
      "514/514 [==============================] - 0s 182us/step - loss: 0.4295 - acc: 0.7899 - val_loss: 0.4704 - val_acc: 0.7638\n",
      "Epoch 1404/2000\n",
      "514/514 [==============================] - 0s 326us/step - loss: 0.4300 - acc: 0.7918 - val_loss: 0.4714 - val_acc: 0.7913\n",
      "Epoch 1405/2000\n",
      "514/514 [==============================] - 0s 201us/step - loss: 0.4454 - acc: 0.7763 - val_loss: 0.5076 - val_acc: 0.7441\n",
      "Epoch 1406/2000\n",
      "514/514 [==============================] - 0s 287us/step - loss: 0.4373 - acc: 0.7763 - val_loss: 0.4670 - val_acc: 0.7795\n",
      "Epoch 1407/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.4319 - acc: 0.7899 - val_loss: 0.4710 - val_acc: 0.7677\n",
      "Epoch 1408/2000\n",
      "514/514 [==============================] - 0s 159us/step - loss: 0.4286 - acc: 0.7840 - val_loss: 0.4770 - val_acc: 0.7953\n",
      "Epoch 1409/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4515 - acc: 0.7840 - val_loss: 0.4854 - val_acc: 0.7520\n",
      "Epoch 1410/2000\n",
      "514/514 [==============================] - 0s 209us/step - loss: 0.4496 - acc: 0.7821 - val_loss: 0.5084 - val_acc: 0.7402\n",
      "Epoch 1411/2000\n",
      "514/514 [==============================] - 0s 195us/step - loss: 0.4507 - acc: 0.7879 - val_loss: 0.4728 - val_acc: 0.7717\n",
      "Epoch 1412/2000\n",
      "514/514 [==============================] - 0s 188us/step - loss: 0.4439 - acc: 0.7879 - val_loss: 0.4708 - val_acc: 0.7874\n",
      "Epoch 1413/2000\n",
      "514/514 [==============================] - 0s 183us/step - loss: 0.4335 - acc: 0.7996 - val_loss: 0.4687 - val_acc: 0.7677\n",
      "Epoch 1414/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.4396 - acc: 0.7957 - val_loss: 0.5223 - val_acc: 0.7087\n",
      "Epoch 1415/2000\n",
      "514/514 [==============================] - 0s 159us/step - loss: 0.4529 - acc: 0.7821 - val_loss: 0.4699 - val_acc: 0.7795\n",
      "Epoch 1416/2000\n",
      "514/514 [==============================] - 0s 233us/step - loss: 0.4343 - acc: 0.7938 - val_loss: 0.4742 - val_acc: 0.7638\n",
      "Epoch 1417/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4312 - acc: 0.7918 - val_loss: 0.4710 - val_acc: 0.7677\n",
      "Epoch 1418/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 143us/step - loss: 0.4335 - acc: 0.7860 - val_loss: 0.4903 - val_acc: 0.7520\n",
      "Epoch 1419/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4372 - acc: 0.7918 - val_loss: 0.4826 - val_acc: 0.7559\n",
      "Epoch 1420/2000\n",
      "514/514 [==============================] - 0s 155us/step - loss: 0.4446 - acc: 0.7996 - val_loss: 0.5038 - val_acc: 0.7913\n",
      "Epoch 1421/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4510 - acc: 0.7743 - val_loss: 0.4648 - val_acc: 0.7795\n",
      "Epoch 1422/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4550 - acc: 0.7685 - val_loss: 0.4681 - val_acc: 0.7598\n",
      "Epoch 1423/2000\n",
      "514/514 [==============================] - 0s 139us/step - loss: 0.4294 - acc: 0.7957 - val_loss: 0.4713 - val_acc: 0.7638\n",
      "Epoch 1424/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4276 - acc: 0.7977 - val_loss: 0.4690 - val_acc: 0.7677\n",
      "Epoch 1425/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4363 - acc: 0.7860 - val_loss: 0.4714 - val_acc: 0.7638\n",
      "Epoch 1426/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4348 - acc: 0.7724 - val_loss: 0.4683 - val_acc: 0.7717\n",
      "Epoch 1427/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4453 - acc: 0.7977 - val_loss: 0.4849 - val_acc: 0.8071\n",
      "Epoch 1428/2000\n",
      "514/514 [==============================] - 0s 149us/step - loss: 0.4549 - acc: 0.7802 - val_loss: 0.4761 - val_acc: 0.7638\n",
      "Epoch 1429/2000\n",
      "514/514 [==============================] - 0s 164us/step - loss: 0.4315 - acc: 0.7899 - val_loss: 0.4690 - val_acc: 0.7677\n",
      "Epoch 1430/2000\n",
      "514/514 [==============================] - 0s 191us/step - loss: 0.4286 - acc: 0.7899 - val_loss: 0.5137 - val_acc: 0.7323\n",
      "Epoch 1431/2000\n",
      "514/514 [==============================] - 0s 137us/step - loss: 0.4609 - acc: 0.7685 - val_loss: 0.4872 - val_acc: 0.7874\n",
      "Epoch 1432/2000\n",
      "514/514 [==============================] - 0s 157us/step - loss: 0.4334 - acc: 0.7860 - val_loss: 0.4716 - val_acc: 0.7638\n",
      "Epoch 1433/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4324 - acc: 0.7860 - val_loss: 0.4762 - val_acc: 0.7677\n",
      "Epoch 1434/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4335 - acc: 0.7938 - val_loss: 0.4831 - val_acc: 0.7480\n",
      "Epoch 1435/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4339 - acc: 0.7938 - val_loss: 0.4699 - val_acc: 0.7598\n",
      "Epoch 1436/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4358 - acc: 0.7840 - val_loss: 0.4841 - val_acc: 0.7559\n",
      "Epoch 1437/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4325 - acc: 0.7938 - val_loss: 0.4696 - val_acc: 0.7677\n",
      "Epoch 1438/2000\n",
      "514/514 [==============================] - 0s 188us/step - loss: 0.4274 - acc: 0.7918 - val_loss: 0.4710 - val_acc: 0.7638\n",
      "Epoch 1439/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4277 - acc: 0.7899 - val_loss: 0.4738 - val_acc: 0.7913\n",
      "Epoch 1440/2000\n",
      "514/514 [==============================] - 0s 195us/step - loss: 0.4412 - acc: 0.7840 - val_loss: 0.4883 - val_acc: 0.7480\n",
      "Epoch 1441/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4362 - acc: 0.7899 - val_loss: 0.4864 - val_acc: 0.7559\n",
      "Epoch 1442/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4302 - acc: 0.7957 - val_loss: 0.4721 - val_acc: 0.7795\n",
      "Epoch 1443/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4352 - acc: 0.7899 - val_loss: 0.4666 - val_acc: 0.7913\n",
      "Epoch 1444/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4309 - acc: 0.7938 - val_loss: 0.4713 - val_acc: 0.7638\n",
      "Epoch 1445/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4256 - acc: 0.7918 - val_loss: 0.4680 - val_acc: 0.7874\n",
      "Epoch 1446/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4392 - acc: 0.7821 - val_loss: 0.4713 - val_acc: 0.7913\n",
      "Epoch 1447/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4353 - acc: 0.7957 - val_loss: 0.4870 - val_acc: 0.8071\n",
      "Epoch 1448/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4413 - acc: 0.7996 - val_loss: 0.5000 - val_acc: 0.7480\n",
      "Epoch 1449/2000\n",
      "514/514 [==============================] - 0s 136us/step - loss: 0.4436 - acc: 0.7860 - val_loss: 0.4727 - val_acc: 0.7874\n",
      "Epoch 1450/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4333 - acc: 0.7899 - val_loss: 0.4660 - val_acc: 0.7874\n",
      "Epoch 1451/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4300 - acc: 0.7821 - val_loss: 0.4689 - val_acc: 0.7874\n",
      "Epoch 1452/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4506 - acc: 0.7899 - val_loss: 0.4663 - val_acc: 0.7874\n",
      "Epoch 1453/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4620 - acc: 0.7879 - val_loss: 0.5188 - val_acc: 0.7244\n",
      "Epoch 1454/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4361 - acc: 0.7938 - val_loss: 0.4694 - val_acc: 0.7835\n",
      "Epoch 1455/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4279 - acc: 0.8016 - val_loss: 0.4737 - val_acc: 0.7835\n",
      "Epoch 1456/2000\n",
      "514/514 [==============================] - 0s 168us/step - loss: 0.4371 - acc: 0.7918 - val_loss: 0.4944 - val_acc: 0.7441\n",
      "Epoch 1457/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4401 - acc: 0.7977 - val_loss: 0.4755 - val_acc: 0.7874\n",
      "Epoch 1458/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4488 - acc: 0.7840 - val_loss: 0.4740 - val_acc: 0.7756\n",
      "Epoch 1459/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4301 - acc: 0.8016 - val_loss: 0.4785 - val_acc: 0.7559\n",
      "Epoch 1460/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4332 - acc: 0.7860 - val_loss: 0.4877 - val_acc: 0.7480\n",
      "Epoch 1461/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4430 - acc: 0.7763 - val_loss: 0.4658 - val_acc: 0.7874\n",
      "Epoch 1462/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.4259 - acc: 0.7879 - val_loss: 0.4730 - val_acc: 0.7756\n",
      "Epoch 1463/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4301 - acc: 0.7879 - val_loss: 0.4712 - val_acc: 0.7717\n",
      "Epoch 1464/2000\n",
      "514/514 [==============================] - 0s 149us/step - loss: 0.4300 - acc: 0.7977 - val_loss: 0.4790 - val_acc: 0.7559\n",
      "Epoch 1465/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4742 - acc: 0.7607 - val_loss: 0.4863 - val_acc: 0.7835\n",
      "Epoch 1466/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4267 - acc: 0.7957 - val_loss: 0.4716 - val_acc: 0.7677\n",
      "Epoch 1467/2000\n",
      "514/514 [==============================] - 0s 148us/step - loss: 0.4487 - acc: 0.7704 - val_loss: 0.4704 - val_acc: 0.7598\n",
      "Epoch 1468/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4453 - acc: 0.7821 - val_loss: 0.4938 - val_acc: 0.7402\n",
      "Epoch 1469/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4460 - acc: 0.7899 - val_loss: 0.4800 - val_acc: 0.8031\n",
      "Epoch 1470/2000\n",
      "514/514 [==============================] - 0s 136us/step - loss: 0.4302 - acc: 0.7899 - val_loss: 0.4940 - val_acc: 0.7480\n",
      "Epoch 1471/2000\n",
      "514/514 [==============================] - 0s 194us/step - loss: 0.4385 - acc: 0.7821 - val_loss: 0.4765 - val_acc: 0.7559\n",
      "Epoch 1472/2000\n",
      "514/514 [==============================] - 0s 148us/step - loss: 0.4322 - acc: 0.8016 - val_loss: 0.4723 - val_acc: 0.7874\n",
      "Epoch 1473/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4310 - acc: 0.7938 - val_loss: 0.5008 - val_acc: 0.7402\n",
      "Epoch 1474/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4417 - acc: 0.7860 - val_loss: 0.4682 - val_acc: 0.7835\n",
      "Epoch 1475/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4250 - acc: 0.7977 - val_loss: 0.4715 - val_acc: 0.7795\n",
      "Epoch 1476/2000\n",
      "514/514 [==============================] - 0s 187us/step - loss: 0.4237 - acc: 0.7899 - val_loss: 0.4705 - val_acc: 0.7874\n",
      "Epoch 1477/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 151us/step - loss: 0.4276 - acc: 0.7977 - val_loss: 0.4832 - val_acc: 0.7677\n",
      "Epoch 1478/2000\n",
      "514/514 [==============================] - 0s 80us/step - loss: 0.4526 - acc: 0.7918 - val_loss: 0.5016 - val_acc: 0.7874\n",
      "Epoch 1479/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4609 - acc: 0.7802 - val_loss: 0.4775 - val_acc: 0.7913\n",
      "Epoch 1480/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4485 - acc: 0.7802 - val_loss: 0.4789 - val_acc: 0.7559\n",
      "Epoch 1481/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4324 - acc: 0.7879 - val_loss: 0.4836 - val_acc: 0.7638\n",
      "Epoch 1482/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4307 - acc: 0.7879 - val_loss: 0.4839 - val_acc: 0.8031\n",
      "Epoch 1483/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4501 - acc: 0.8074 - val_loss: 0.5311 - val_acc: 0.7165\n",
      "Epoch 1484/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4595 - acc: 0.7665 - val_loss: 0.4667 - val_acc: 0.7835\n",
      "Epoch 1485/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4688 - acc: 0.7704 - val_loss: 0.4665 - val_acc: 0.7992\n",
      "Epoch 1486/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4455 - acc: 0.7840 - val_loss: 0.4605 - val_acc: 0.7992\n",
      "Epoch 1487/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4311 - acc: 0.7918 - val_loss: 0.4705 - val_acc: 0.7953\n",
      "Epoch 1488/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4326 - acc: 0.7840 - val_loss: 0.4739 - val_acc: 0.7677\n",
      "Epoch 1489/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4370 - acc: 0.7840 - val_loss: 0.4718 - val_acc: 0.7638\n",
      "Epoch 1490/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4348 - acc: 0.7918 - val_loss: 0.4725 - val_acc: 0.7874\n",
      "Epoch 1491/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4268 - acc: 0.7996 - val_loss: 0.4805 - val_acc: 0.7638\n",
      "Epoch 1492/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4295 - acc: 0.7977 - val_loss: 0.4715 - val_acc: 0.7795\n",
      "Epoch 1493/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4292 - acc: 0.7938 - val_loss: 0.4714 - val_acc: 0.7677\n",
      "Epoch 1494/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4336 - acc: 0.7977 - val_loss: 0.4740 - val_acc: 0.7756\n",
      "Epoch 1495/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4299 - acc: 0.7860 - val_loss: 0.4726 - val_acc: 0.7717\n",
      "Epoch 1496/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4282 - acc: 0.7802 - val_loss: 0.4710 - val_acc: 0.7795\n",
      "Epoch 1497/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4323 - acc: 0.7860 - val_loss: 0.4689 - val_acc: 0.7874\n",
      "Epoch 1498/2000\n",
      "514/514 [==============================] - 0s 192us/step - loss: 0.4283 - acc: 0.7938 - val_loss: 0.4690 - val_acc: 0.7756\n",
      "Epoch 1499/2000\n",
      "514/514 [==============================] - 0s 179us/step - loss: 0.4271 - acc: 0.7918 - val_loss: 0.4724 - val_acc: 0.7677\n",
      "Epoch 1500/2000\n",
      "514/514 [==============================] - 0s 81us/step - loss: 0.4271 - acc: 0.7821 - val_loss: 0.4676 - val_acc: 0.7795\n",
      "Epoch 1501/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4382 - acc: 0.7704 - val_loss: 0.4756 - val_acc: 0.7756\n",
      "Epoch 1502/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4279 - acc: 0.7879 - val_loss: 0.4676 - val_acc: 0.7874\n",
      "Epoch 1503/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4280 - acc: 0.7957 - val_loss: 0.4685 - val_acc: 0.7795\n",
      "Epoch 1504/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4410 - acc: 0.7743 - val_loss: 0.4757 - val_acc: 0.7520\n",
      "Epoch 1505/2000\n",
      "514/514 [==============================] - 0s 255us/step - loss: 0.4250 - acc: 0.7879 - val_loss: 0.4669 - val_acc: 0.7835\n",
      "Epoch 1506/2000\n",
      "514/514 [==============================] - 0s 246us/step - loss: 0.4375 - acc: 0.7879 - val_loss: 0.4719 - val_acc: 0.7874\n",
      "Epoch 1507/2000\n",
      "514/514 [==============================] - 0s 229us/step - loss: 0.4373 - acc: 0.7879 - val_loss: 0.4841 - val_acc: 0.7559\n",
      "Epoch 1508/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4304 - acc: 0.7879 - val_loss: 0.4704 - val_acc: 0.7795\n",
      "Epoch 1509/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4341 - acc: 0.7860 - val_loss: 0.4759 - val_acc: 0.7638\n",
      "Epoch 1510/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4228 - acc: 0.7977 - val_loss: 0.4732 - val_acc: 0.7756\n",
      "Epoch 1511/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4239 - acc: 0.7938 - val_loss: 0.4737 - val_acc: 0.7677\n",
      "Epoch 1512/2000\n",
      "514/514 [==============================] - 0s 215us/step - loss: 0.4266 - acc: 0.7918 - val_loss: 0.4717 - val_acc: 0.7677\n",
      "Epoch 1513/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4322 - acc: 0.7957 - val_loss: 0.4880 - val_acc: 0.7559\n",
      "Epoch 1514/2000\n",
      "514/514 [==============================] - 0s 205us/step - loss: 0.4256 - acc: 0.7957 - val_loss: 0.4832 - val_acc: 0.7992\n",
      "Epoch 1515/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4305 - acc: 0.8016 - val_loss: 0.4813 - val_acc: 0.7441\n",
      "Epoch 1516/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4322 - acc: 0.7938 - val_loss: 0.4748 - val_acc: 0.7795\n",
      "Epoch 1517/2000\n",
      "514/514 [==============================] - 0s 144us/step - loss: 0.4275 - acc: 0.7879 - val_loss: 0.4711 - val_acc: 0.7598\n",
      "Epoch 1518/2000\n",
      "514/514 [==============================] - 0s 156us/step - loss: 0.4407 - acc: 0.7821 - val_loss: 0.4712 - val_acc: 0.7913\n",
      "Epoch 1519/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4295 - acc: 0.7879 - val_loss: 0.4719 - val_acc: 0.7913\n",
      "Epoch 1520/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4266 - acc: 0.7996 - val_loss: 0.4791 - val_acc: 0.7913\n",
      "Epoch 1521/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4417 - acc: 0.7782 - val_loss: 0.4869 - val_acc: 0.7362\n",
      "Epoch 1522/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4218 - acc: 0.7996 - val_loss: 0.4745 - val_acc: 0.7835\n",
      "Epoch 1523/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4210 - acc: 0.7957 - val_loss: 0.4818 - val_acc: 0.7677\n",
      "Epoch 1524/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4385 - acc: 0.7899 - val_loss: 0.4796 - val_acc: 0.7953\n",
      "Epoch 1525/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4946 - acc: 0.7432 - val_loss: 0.4826 - val_acc: 0.7677\n",
      "Epoch 1526/2000\n",
      "514/514 [==============================] - 0s 139us/step - loss: 0.4651 - acc: 0.7549 - val_loss: 0.4796 - val_acc: 0.7992\n",
      "Epoch 1527/2000\n",
      "514/514 [==============================] - 0s 175us/step - loss: 0.4436 - acc: 0.7938 - val_loss: 0.4842 - val_acc: 0.7677\n",
      "Epoch 1528/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4418 - acc: 0.7879 - val_loss: 0.4837 - val_acc: 0.7756\n",
      "Epoch 1529/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4332 - acc: 0.7938 - val_loss: 0.4704 - val_acc: 0.7913\n",
      "Epoch 1530/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4269 - acc: 0.7879 - val_loss: 0.4720 - val_acc: 0.7795\n",
      "Epoch 1531/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4453 - acc: 0.7957 - val_loss: 0.4960 - val_acc: 0.7480\n",
      "Epoch 1532/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4415 - acc: 0.7938 - val_loss: 0.4806 - val_acc: 0.7638\n",
      "Epoch 1533/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4296 - acc: 0.7996 - val_loss: 0.4806 - val_acc: 0.7598\n",
      "Epoch 1534/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4324 - acc: 0.7918 - val_loss: 0.4782 - val_acc: 0.7717\n",
      "Epoch 1535/2000\n",
      "514/514 [==============================] - 0s 200us/step - loss: 0.4403 - acc: 0.7938 - val_loss: 0.4691 - val_acc: 0.7835\n",
      "Epoch 1536/2000\n",
      "514/514 [==============================] - 0s 212us/step - loss: 0.4300 - acc: 0.7977 - val_loss: 0.4690 - val_acc: 0.7913\n",
      "Epoch 1537/2000\n",
      "514/514 [==============================] - 0s 219us/step - loss: 0.4531 - acc: 0.7821 - val_loss: 0.4700 - val_acc: 0.7756\n",
      "Epoch 1538/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4262 - acc: 0.8016 - val_loss: 0.4810 - val_acc: 0.7638\n",
      "Epoch 1539/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4332 - acc: 0.7938 - val_loss: 0.4809 - val_acc: 0.7480\n",
      "Epoch 1540/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4303 - acc: 0.7918 - val_loss: 0.4686 - val_acc: 0.7795\n",
      "Epoch 1541/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4253 - acc: 0.7879 - val_loss: 0.4702 - val_acc: 0.7795\n",
      "Epoch 1542/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4296 - acc: 0.7918 - val_loss: 0.4690 - val_acc: 0.7795\n",
      "Epoch 1543/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4241 - acc: 0.7996 - val_loss: 0.4695 - val_acc: 0.7835\n",
      "Epoch 1544/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4273 - acc: 0.7938 - val_loss: 0.4664 - val_acc: 0.7913\n",
      "Epoch 1545/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4400 - acc: 0.7782 - val_loss: 0.4711 - val_acc: 0.7756\n",
      "Epoch 1546/2000\n",
      "514/514 [==============================] - 0s 208us/step - loss: 0.4521 - acc: 0.7802 - val_loss: 0.4801 - val_acc: 0.7441\n",
      "Epoch 1547/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4539 - acc: 0.7724 - val_loss: 0.4925 - val_acc: 0.7441\n",
      "Epoch 1548/2000\n",
      "514/514 [==============================] - 0s 153us/step - loss: 0.4284 - acc: 0.7899 - val_loss: 0.4745 - val_acc: 0.7756\n",
      "Epoch 1549/2000\n",
      "514/514 [==============================] - 0s 196us/step - loss: 0.4400 - acc: 0.7957 - val_loss: 0.4768 - val_acc: 0.7874\n",
      "Epoch 1550/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4246 - acc: 0.7977 - val_loss: 0.4660 - val_acc: 0.7835\n",
      "Epoch 1551/2000\n",
      "514/514 [==============================] - 0s 168us/step - loss: 0.4253 - acc: 0.7918 - val_loss: 0.4670 - val_acc: 0.7874\n",
      "Epoch 1552/2000\n",
      "514/514 [==============================] - 0s 139us/step - loss: 0.4374 - acc: 0.7899 - val_loss: 0.4719 - val_acc: 0.7598\n",
      "Epoch 1553/2000\n",
      "514/514 [==============================] - 0s 152us/step - loss: 0.4324 - acc: 0.7860 - val_loss: 0.4733 - val_acc: 0.7677\n",
      "Epoch 1554/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4288 - acc: 0.7957 - val_loss: 0.4663 - val_acc: 0.7835\n",
      "Epoch 1555/2000\n",
      "514/514 [==============================] - 0s 152us/step - loss: 0.4240 - acc: 0.7879 - val_loss: 0.4725 - val_acc: 0.7677\n",
      "Epoch 1556/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4324 - acc: 0.7918 - val_loss: 0.4781 - val_acc: 0.7795\n",
      "Epoch 1557/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4267 - acc: 0.7840 - val_loss: 0.4688 - val_acc: 0.7677\n",
      "Epoch 1558/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4259 - acc: 0.7918 - val_loss: 0.4738 - val_acc: 0.7559\n",
      "Epoch 1559/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4361 - acc: 0.7821 - val_loss: 0.4695 - val_acc: 0.7677\n",
      "Epoch 1560/2000\n",
      "514/514 [==============================] - 0s 136us/step - loss: 0.4231 - acc: 0.7977 - val_loss: 0.4756 - val_acc: 0.7717\n",
      "Epoch 1561/2000\n",
      "514/514 [==============================] - 0s 143us/step - loss: 0.4314 - acc: 0.7977 - val_loss: 0.4775 - val_acc: 0.7717\n",
      "Epoch 1562/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4238 - acc: 0.7918 - val_loss: 0.4729 - val_acc: 0.7717\n",
      "Epoch 1563/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4227 - acc: 0.7879 - val_loss: 0.4756 - val_acc: 0.7717\n",
      "Epoch 1564/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4275 - acc: 0.7938 - val_loss: 0.4747 - val_acc: 0.7874\n",
      "Epoch 1565/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4256 - acc: 0.7802 - val_loss: 0.4809 - val_acc: 0.7559\n",
      "Epoch 1566/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4383 - acc: 0.7821 - val_loss: 0.4953 - val_acc: 0.7992\n",
      "Epoch 1567/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4616 - acc: 0.7802 - val_loss: 0.4714 - val_acc: 0.7756\n",
      "Epoch 1568/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4239 - acc: 0.7879 - val_loss: 0.4805 - val_acc: 0.7874\n",
      "Epoch 1569/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4404 - acc: 0.7782 - val_loss: 0.4894 - val_acc: 0.7638\n",
      "Epoch 1570/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4354 - acc: 0.7802 - val_loss: 0.4954 - val_acc: 0.7913\n",
      "Epoch 1571/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4578 - acc: 0.7685 - val_loss: 0.4739 - val_acc: 0.7953\n",
      "Epoch 1572/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4325 - acc: 0.7918 - val_loss: 0.4913 - val_acc: 0.7520\n",
      "Epoch 1573/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4399 - acc: 0.7802 - val_loss: 0.4745 - val_acc: 0.7835\n",
      "Epoch 1574/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4223 - acc: 0.7899 - val_loss: 0.4849 - val_acc: 0.7835\n",
      "Epoch 1575/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4320 - acc: 0.7899 - val_loss: 0.5001 - val_acc: 0.7520\n",
      "Epoch 1576/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4330 - acc: 0.7860 - val_loss: 0.4810 - val_acc: 0.7756\n",
      "Epoch 1577/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4348 - acc: 0.7957 - val_loss: 0.4879 - val_acc: 0.7480\n",
      "Epoch 1578/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4285 - acc: 0.7918 - val_loss: 0.4764 - val_acc: 0.7756\n",
      "Epoch 1579/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4285 - acc: 0.7918 - val_loss: 0.4908 - val_acc: 0.7441\n",
      "Epoch 1580/2000\n",
      "514/514 [==============================] - 0s 143us/step - loss: 0.4275 - acc: 0.7957 - val_loss: 0.4909 - val_acc: 0.7480\n",
      "Epoch 1581/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4255 - acc: 0.7840 - val_loss: 0.4895 - val_acc: 0.7480\n",
      "Epoch 1582/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4239 - acc: 0.7938 - val_loss: 0.4887 - val_acc: 0.7874\n",
      "Epoch 1583/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4459 - acc: 0.7860 - val_loss: 0.4834 - val_acc: 0.7480\n",
      "Epoch 1584/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4275 - acc: 0.7879 - val_loss: 0.4819 - val_acc: 0.7953\n",
      "Epoch 1585/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4331 - acc: 0.7782 - val_loss: 0.4776 - val_acc: 0.7756\n",
      "Epoch 1586/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4426 - acc: 0.7918 - val_loss: 0.4828 - val_acc: 0.8031\n",
      "Epoch 1587/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4462 - acc: 0.7802 - val_loss: 0.5077 - val_acc: 0.7402\n",
      "Epoch 1588/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4323 - acc: 0.7879 - val_loss: 0.4843 - val_acc: 0.7638\n",
      "Epoch 1589/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4218 - acc: 0.7879 - val_loss: 0.4852 - val_acc: 0.7520\n",
      "Epoch 1590/2000\n",
      "514/514 [==============================] - 0s 153us/step - loss: 0.4249 - acc: 0.7918 - val_loss: 0.4929 - val_acc: 0.7520\n",
      "Epoch 1591/2000\n",
      "514/514 [==============================] - 0s 136us/step - loss: 0.4478 - acc: 0.7860 - val_loss: 0.4961 - val_acc: 0.8031\n",
      "Epoch 1592/2000\n",
      "514/514 [==============================] - 0s 205us/step - loss: 0.4273 - acc: 0.7821 - val_loss: 0.4795 - val_acc: 0.7835\n",
      "Epoch 1593/2000\n",
      "514/514 [==============================] - 0s 92us/step - loss: 0.4337 - acc: 0.7743 - val_loss: 0.4789 - val_acc: 0.7480\n",
      "Epoch 1594/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4213 - acc: 0.7879 - val_loss: 0.4761 - val_acc: 0.7874\n",
      "Epoch 1595/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 142us/step - loss: 0.4294 - acc: 0.7879 - val_loss: 0.4781 - val_acc: 0.7638\n",
      "Epoch 1596/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4219 - acc: 0.7840 - val_loss: 0.4984 - val_acc: 0.7480\n",
      "Epoch 1597/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4510 - acc: 0.7763 - val_loss: 0.4816 - val_acc: 0.8031\n",
      "Epoch 1598/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4220 - acc: 0.7899 - val_loss: 0.4990 - val_acc: 0.7441\n",
      "Epoch 1599/2000\n",
      "514/514 [==============================] - 0s 91us/step - loss: 0.4256 - acc: 0.8016 - val_loss: 0.4837 - val_acc: 0.7795\n",
      "Epoch 1600/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4231 - acc: 0.7938 - val_loss: 0.4910 - val_acc: 0.7480\n",
      "Epoch 1601/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4229 - acc: 0.7879 - val_loss: 0.4822 - val_acc: 0.7756\n",
      "Epoch 1602/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4171 - acc: 0.7957 - val_loss: 0.4888 - val_acc: 0.7441\n",
      "Epoch 1603/2000\n",
      "514/514 [==============================] - 0s 186us/step - loss: 0.4194 - acc: 0.7957 - val_loss: 0.4804 - val_acc: 0.7913\n",
      "Epoch 1604/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.4189 - acc: 0.7938 - val_loss: 0.4863 - val_acc: 0.7598\n",
      "Epoch 1605/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4262 - acc: 0.7957 - val_loss: 0.4884 - val_acc: 0.7638\n",
      "Epoch 1606/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4223 - acc: 0.7879 - val_loss: 0.4815 - val_acc: 0.7717\n",
      "Epoch 1607/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4250 - acc: 0.7899 - val_loss: 0.4979 - val_acc: 0.7480\n",
      "Epoch 1608/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4542 - acc: 0.7821 - val_loss: 0.4775 - val_acc: 0.8031\n",
      "Epoch 1609/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4196 - acc: 0.7957 - val_loss: 0.4939 - val_acc: 0.7559\n",
      "Epoch 1610/2000\n",
      "514/514 [==============================] - 0s 161us/step - loss: 0.4312 - acc: 0.7899 - val_loss: 0.4975 - val_acc: 0.7953\n",
      "Epoch 1611/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4326 - acc: 0.8035 - val_loss: 0.4768 - val_acc: 0.7638\n",
      "Epoch 1612/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4334 - acc: 0.7918 - val_loss: 0.4718 - val_acc: 0.7835\n",
      "Epoch 1613/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4266 - acc: 0.7879 - val_loss: 0.4777 - val_acc: 0.7795\n",
      "Epoch 1614/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4250 - acc: 0.7899 - val_loss: 0.4869 - val_acc: 0.8071\n",
      "Epoch 1615/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4358 - acc: 0.7899 - val_loss: 0.4823 - val_acc: 0.7795\n",
      "Epoch 1616/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4260 - acc: 0.7957 - val_loss: 0.4793 - val_acc: 0.7677\n",
      "Epoch 1617/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.4239 - acc: 0.7879 - val_loss: 0.4816 - val_acc: 0.7835\n",
      "Epoch 1618/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4213 - acc: 0.7879 - val_loss: 0.4792 - val_acc: 0.7874\n",
      "Epoch 1619/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4195 - acc: 0.7938 - val_loss: 0.4991 - val_acc: 0.7480\n",
      "Epoch 1620/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4325 - acc: 0.7879 - val_loss: 0.4797 - val_acc: 0.7677\n",
      "Epoch 1621/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4228 - acc: 0.7821 - val_loss: 0.4969 - val_acc: 0.7480\n",
      "Epoch 1622/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4594 - acc: 0.7685 - val_loss: 0.5181 - val_acc: 0.7874\n",
      "Epoch 1623/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4454 - acc: 0.7782 - val_loss: 0.4757 - val_acc: 0.7756\n",
      "Epoch 1624/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4311 - acc: 0.7840 - val_loss: 0.4786 - val_acc: 0.7795\n",
      "Epoch 1625/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4150 - acc: 0.7918 - val_loss: 0.4894 - val_acc: 0.7717\n",
      "Epoch 1626/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4159 - acc: 0.7977 - val_loss: 0.4987 - val_acc: 0.7480\n",
      "Epoch 1627/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4253 - acc: 0.7918 - val_loss: 0.4957 - val_acc: 0.7402\n",
      "Epoch 1628/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4354 - acc: 0.7918 - val_loss: 0.4811 - val_acc: 0.7795\n",
      "Epoch 1629/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4235 - acc: 0.7899 - val_loss: 0.4813 - val_acc: 0.7835\n",
      "Epoch 1630/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4238 - acc: 0.7840 - val_loss: 0.4834 - val_acc: 0.7913\n",
      "Epoch 1631/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4175 - acc: 0.7957 - val_loss: 0.4843 - val_acc: 0.7913\n",
      "Epoch 1632/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4409 - acc: 0.7957 - val_loss: 0.4776 - val_acc: 0.7598\n",
      "Epoch 1633/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4411 - acc: 0.7782 - val_loss: 0.4799 - val_acc: 0.7913\n",
      "Epoch 1634/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4427 - acc: 0.7879 - val_loss: 0.4978 - val_acc: 0.7402\n",
      "Epoch 1635/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4328 - acc: 0.7918 - val_loss: 0.4777 - val_acc: 0.7953\n",
      "Epoch 1636/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4286 - acc: 0.7938 - val_loss: 0.5017 - val_acc: 0.7441\n",
      "Epoch 1637/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.5697 - acc: 0.6946 - val_loss: 0.5043 - val_acc: 0.7874\n",
      "Epoch 1638/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4945 - acc: 0.7802 - val_loss: 0.4807 - val_acc: 0.7598\n",
      "Epoch 1639/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4539 - acc: 0.7802 - val_loss: 0.4732 - val_acc: 0.7835\n",
      "Epoch 1640/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4442 - acc: 0.7860 - val_loss: 0.4772 - val_acc: 0.7992\n",
      "Epoch 1641/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4436 - acc: 0.7918 - val_loss: 0.4715 - val_acc: 0.7795\n",
      "Epoch 1642/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4409 - acc: 0.7840 - val_loss: 0.4743 - val_acc: 0.7874\n",
      "Epoch 1643/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4349 - acc: 0.7840 - val_loss: 0.4710 - val_acc: 0.7874\n",
      "Epoch 1644/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4338 - acc: 0.7860 - val_loss: 0.4726 - val_acc: 0.7835\n",
      "Epoch 1645/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4279 - acc: 0.7879 - val_loss: 0.4764 - val_acc: 0.7638\n",
      "Epoch 1646/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4299 - acc: 0.7860 - val_loss: 0.4676 - val_acc: 0.7874\n",
      "Epoch 1647/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4219 - acc: 0.7938 - val_loss: 0.4728 - val_acc: 0.7756\n",
      "Epoch 1648/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4421 - acc: 0.7918 - val_loss: 0.4871 - val_acc: 0.7441\n",
      "Epoch 1649/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4371 - acc: 0.7957 - val_loss: 0.4732 - val_acc: 0.7953\n",
      "Epoch 1650/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.4250 - acc: 0.7957 - val_loss: 0.4796 - val_acc: 0.7835\n",
      "Epoch 1651/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.4297 - acc: 0.7879 - val_loss: 0.5247 - val_acc: 0.7244\n",
      "Epoch 1652/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4884 - acc: 0.7743 - val_loss: 0.4795 - val_acc: 0.7913\n",
      "Epoch 1653/2000\n",
      "514/514 [==============================] - 0s 147us/step - loss: 0.4303 - acc: 0.7802 - val_loss: 0.4808 - val_acc: 0.7638\n",
      "Epoch 1654/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 123us/step - loss: 0.4270 - acc: 0.7918 - val_loss: 0.4833 - val_acc: 0.7638\n",
      "Epoch 1655/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4285 - acc: 0.7802 - val_loss: 0.4777 - val_acc: 0.7874\n",
      "Epoch 1656/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4227 - acc: 0.7938 - val_loss: 0.4791 - val_acc: 0.7835\n",
      "Epoch 1657/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4175 - acc: 0.7957 - val_loss: 0.4943 - val_acc: 0.7520\n",
      "Epoch 1658/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4253 - acc: 0.7802 - val_loss: 0.4821 - val_acc: 0.7677\n",
      "Epoch 1659/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4184 - acc: 0.7996 - val_loss: 0.4799 - val_acc: 0.7874\n",
      "Epoch 1660/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4289 - acc: 0.7743 - val_loss: 0.4787 - val_acc: 0.7835\n",
      "Epoch 1661/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4404 - acc: 0.7763 - val_loss: 0.4973 - val_acc: 0.8031\n",
      "Epoch 1662/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4232 - acc: 0.7802 - val_loss: 0.4837 - val_acc: 0.7835\n",
      "Epoch 1663/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4432 - acc: 0.7763 - val_loss: 0.4848 - val_acc: 0.7638\n",
      "Epoch 1664/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4197 - acc: 0.7821 - val_loss: 0.4779 - val_acc: 0.7756\n",
      "Epoch 1665/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4187 - acc: 0.7860 - val_loss: 0.4908 - val_acc: 0.7441\n",
      "Epoch 1666/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4236 - acc: 0.8054 - val_loss: 0.4899 - val_acc: 0.7913\n",
      "Epoch 1667/2000\n",
      "514/514 [==============================] - 0s 155us/step - loss: 0.4470 - acc: 0.7802 - val_loss: 0.4792 - val_acc: 0.7835\n",
      "Epoch 1668/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4499 - acc: 0.7840 - val_loss: 0.4770 - val_acc: 0.7756\n",
      "Epoch 1669/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4384 - acc: 0.7763 - val_loss: 0.4873 - val_acc: 0.7559\n",
      "Epoch 1670/2000\n",
      "514/514 [==============================] - 0s 165us/step - loss: 0.4337 - acc: 0.7860 - val_loss: 0.4843 - val_acc: 0.7638\n",
      "Epoch 1671/2000\n",
      "514/514 [==============================] - 0s 87us/step - loss: 0.4211 - acc: 0.8132 - val_loss: 0.4821 - val_acc: 0.7913\n",
      "Epoch 1672/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4402 - acc: 0.7957 - val_loss: 0.4804 - val_acc: 0.7520\n",
      "Epoch 1673/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.4361 - acc: 0.7957 - val_loss: 0.4887 - val_acc: 0.7598\n",
      "Epoch 1674/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4226 - acc: 0.7918 - val_loss: 0.4883 - val_acc: 0.7953\n",
      "Epoch 1675/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4228 - acc: 0.7918 - val_loss: 0.4952 - val_acc: 0.7559\n",
      "Epoch 1676/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4243 - acc: 0.7879 - val_loss: 0.4843 - val_acc: 0.7520\n",
      "Epoch 1677/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4186 - acc: 0.7996 - val_loss: 0.4877 - val_acc: 0.7835\n",
      "Epoch 1678/2000\n",
      "514/514 [==============================] - 0s 140us/step - loss: 0.4476 - acc: 0.7918 - val_loss: 0.4924 - val_acc: 0.8031\n",
      "Epoch 1679/2000\n",
      "514/514 [==============================] - 0s 192us/step - loss: 0.4461 - acc: 0.7977 - val_loss: 0.4842 - val_acc: 0.7362\n",
      "Epoch 1680/2000\n",
      "514/514 [==============================] - 0s 170us/step - loss: 0.4329 - acc: 0.7879 - val_loss: 0.4798 - val_acc: 0.7520\n",
      "Epoch 1681/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4464 - acc: 0.8074 - val_loss: 0.4891 - val_acc: 0.8071\n",
      "Epoch 1682/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4305 - acc: 0.7879 - val_loss: 0.4754 - val_acc: 0.8071\n",
      "Epoch 1683/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4338 - acc: 0.7840 - val_loss: 0.4830 - val_acc: 0.7756\n",
      "Epoch 1684/2000\n",
      "514/514 [==============================] - 0s 137us/step - loss: 0.4182 - acc: 0.7938 - val_loss: 0.4826 - val_acc: 0.7677\n",
      "Epoch 1685/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4148 - acc: 0.7957 - val_loss: 0.4832 - val_acc: 0.7835\n",
      "Epoch 1686/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4163 - acc: 0.7879 - val_loss: 0.4815 - val_acc: 0.7717\n",
      "Epoch 1687/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4270 - acc: 0.7957 - val_loss: 0.4981 - val_acc: 0.7520\n",
      "Epoch 1688/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4276 - acc: 0.7821 - val_loss: 0.4825 - val_acc: 0.7835\n",
      "Epoch 1689/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4187 - acc: 0.7879 - val_loss: 0.4944 - val_acc: 0.7520\n",
      "Epoch 1690/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4188 - acc: 0.7879 - val_loss: 0.4907 - val_acc: 0.7480\n",
      "Epoch 1691/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4359 - acc: 0.7957 - val_loss: 0.4973 - val_acc: 0.8031\n",
      "Epoch 1692/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4236 - acc: 0.7879 - val_loss: 0.4828 - val_acc: 0.7717\n",
      "Epoch 1693/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4135 - acc: 0.7957 - val_loss: 0.4927 - val_acc: 0.7717\n",
      "Epoch 1694/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4372 - acc: 0.7918 - val_loss: 0.4846 - val_acc: 0.7756\n",
      "Epoch 1695/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4208 - acc: 0.7860 - val_loss: 0.4825 - val_acc: 0.7835\n",
      "Epoch 1696/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4222 - acc: 0.7879 - val_loss: 0.4846 - val_acc: 0.7756\n",
      "Epoch 1697/2000\n",
      "514/514 [==============================] - 0s 179us/step - loss: 0.4127 - acc: 0.7918 - val_loss: 0.5125 - val_acc: 0.8110\n",
      "Epoch 1698/2000\n",
      "514/514 [==============================] - 0s 92us/step - loss: 0.4310 - acc: 0.7957 - val_loss: 0.4832 - val_acc: 0.7638\n",
      "Epoch 1699/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4199 - acc: 0.7938 - val_loss: 0.4858 - val_acc: 0.7795\n",
      "Epoch 1700/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4197 - acc: 0.7938 - val_loss: 0.4952 - val_acc: 0.7441\n",
      "Epoch 1701/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4530 - acc: 0.7782 - val_loss: 0.4929 - val_acc: 0.8031\n",
      "Epoch 1702/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4301 - acc: 0.7957 - val_loss: 0.4886 - val_acc: 0.7913\n",
      "Epoch 1703/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4261 - acc: 0.7879 - val_loss: 0.4855 - val_acc: 0.7598\n",
      "Epoch 1704/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4146 - acc: 0.7918 - val_loss: 0.4822 - val_acc: 0.7795\n",
      "Epoch 1705/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4148 - acc: 0.7899 - val_loss: 0.4818 - val_acc: 0.7756\n",
      "Epoch 1706/2000\n",
      "514/514 [==============================] - 0s 142us/step - loss: 0.4177 - acc: 0.7938 - val_loss: 0.4904 - val_acc: 0.7598\n",
      "Epoch 1707/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4283 - acc: 0.7899 - val_loss: 0.5094 - val_acc: 0.7441\n",
      "Epoch 1708/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4328 - acc: 0.7879 - val_loss: 0.4885 - val_acc: 0.7598\n",
      "Epoch 1709/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4229 - acc: 0.7821 - val_loss: 0.5190 - val_acc: 0.7283\n",
      "Epoch 1710/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4351 - acc: 0.7918 - val_loss: 0.4923 - val_acc: 0.7992\n",
      "Epoch 1711/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4214 - acc: 0.8113 - val_loss: 0.4859 - val_acc: 0.7677\n",
      "Epoch 1712/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4264 - acc: 0.7918 - val_loss: 0.4821 - val_acc: 0.7835\n",
      "Epoch 1713/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 125us/step - loss: 0.4160 - acc: 0.8016 - val_loss: 0.4875 - val_acc: 0.7598\n",
      "Epoch 1714/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4597 - acc: 0.7821 - val_loss: 0.4834 - val_acc: 0.7795\n",
      "Epoch 1715/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4244 - acc: 0.7996 - val_loss: 0.5054 - val_acc: 0.7992\n",
      "Epoch 1716/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4243 - acc: 0.7918 - val_loss: 0.4901 - val_acc: 0.7835\n",
      "Epoch 1717/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4165 - acc: 0.7957 - val_loss: 0.4924 - val_acc: 0.7795\n",
      "Epoch 1718/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4252 - acc: 0.8035 - val_loss: 0.5239 - val_acc: 0.8110\n",
      "Epoch 1719/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4333 - acc: 0.7996 - val_loss: 0.5210 - val_acc: 0.7244\n",
      "Epoch 1720/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4319 - acc: 0.7782 - val_loss: 0.4862 - val_acc: 0.7638\n",
      "Epoch 1721/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4300 - acc: 0.7899 - val_loss: 0.4885 - val_acc: 0.7874\n",
      "Epoch 1722/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4375 - acc: 0.7879 - val_loss: 0.5451 - val_acc: 0.6929\n",
      "Epoch 1723/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4413 - acc: 0.7938 - val_loss: 0.4885 - val_acc: 0.7480\n",
      "Epoch 1724/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4529 - acc: 0.7977 - val_loss: 0.5070 - val_acc: 0.7953\n",
      "Epoch 1725/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4619 - acc: 0.7704 - val_loss: 0.4932 - val_acc: 0.7402\n",
      "Epoch 1726/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4333 - acc: 0.7977 - val_loss: 0.4714 - val_acc: 0.7795\n",
      "Epoch 1727/2000\n",
      "514/514 [==============================] - 0s 180us/step - loss: 0.4339 - acc: 0.7899 - val_loss: 0.4755 - val_acc: 0.7835\n",
      "Epoch 1728/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4224 - acc: 0.7899 - val_loss: 0.4756 - val_acc: 0.7835\n",
      "Epoch 1729/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4243 - acc: 0.7840 - val_loss: 0.4853 - val_acc: 0.7717\n",
      "Epoch 1730/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4118 - acc: 0.7899 - val_loss: 0.4896 - val_acc: 0.7480\n",
      "Epoch 1731/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4320 - acc: 0.7840 - val_loss: 0.4954 - val_acc: 0.7441\n",
      "Epoch 1732/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4285 - acc: 0.7938 - val_loss: 0.4875 - val_acc: 0.7638\n",
      "Epoch 1733/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4120 - acc: 0.8054 - val_loss: 0.4881 - val_acc: 0.7874\n",
      "Epoch 1734/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4148 - acc: 0.7957 - val_loss: 0.4828 - val_acc: 0.7795\n",
      "Epoch 1735/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4093 - acc: 0.7957 - val_loss: 0.4964 - val_acc: 0.7480\n",
      "Epoch 1736/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4284 - acc: 0.8054 - val_loss: 0.4896 - val_acc: 0.7835\n",
      "Epoch 1737/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4294 - acc: 0.7899 - val_loss: 0.4935 - val_acc: 0.8071\n",
      "Epoch 1738/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4567 - acc: 0.7685 - val_loss: 0.4820 - val_acc: 0.7835\n",
      "Epoch 1739/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4283 - acc: 0.7918 - val_loss: 0.4831 - val_acc: 0.7795\n",
      "Epoch 1740/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4243 - acc: 0.7899 - val_loss: 0.4967 - val_acc: 0.7992\n",
      "Epoch 1741/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4228 - acc: 0.7938 - val_loss: 0.4970 - val_acc: 0.7480\n",
      "Epoch 1742/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4224 - acc: 0.7938 - val_loss: 0.4916 - val_acc: 0.7441\n",
      "Epoch 1743/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4147 - acc: 0.7996 - val_loss: 0.4922 - val_acc: 0.7480\n",
      "Epoch 1744/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4193 - acc: 0.7996 - val_loss: 0.4878 - val_acc: 0.7835\n",
      "Epoch 1745/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4188 - acc: 0.7938 - val_loss: 0.4854 - val_acc: 0.7795\n",
      "Epoch 1746/2000\n",
      "514/514 [==============================] - 0s 141us/step - loss: 0.4110 - acc: 0.7938 - val_loss: 0.4879 - val_acc: 0.7874\n",
      "Epoch 1747/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4178 - acc: 0.7899 - val_loss: 0.4909 - val_acc: 0.7835\n",
      "Epoch 1748/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.4230 - acc: 0.8035 - val_loss: 0.4878 - val_acc: 0.7835\n",
      "Epoch 1749/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4202 - acc: 0.7724 - val_loss: 0.4903 - val_acc: 0.7598\n",
      "Epoch 1750/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4156 - acc: 0.7879 - val_loss: 0.4931 - val_acc: 0.7598\n",
      "Epoch 1751/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4311 - acc: 0.7977 - val_loss: 0.4857 - val_acc: 0.7874\n",
      "Epoch 1752/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4089 - acc: 0.7977 - val_loss: 0.4936 - val_acc: 0.7835\n",
      "Epoch 1753/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4115 - acc: 0.7840 - val_loss: 0.4951 - val_acc: 0.7520\n",
      "Epoch 1754/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4321 - acc: 0.7938 - val_loss: 0.5106 - val_acc: 0.7362\n",
      "Epoch 1755/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4448 - acc: 0.7743 - val_loss: 0.4845 - val_acc: 0.7835\n",
      "Epoch 1756/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4243 - acc: 0.7938 - val_loss: 0.4843 - val_acc: 0.7835\n",
      "Epoch 1757/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4140 - acc: 0.7938 - val_loss: 0.4909 - val_acc: 0.7717\n",
      "Epoch 1758/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4192 - acc: 0.7996 - val_loss: 0.5044 - val_acc: 0.7480\n",
      "Epoch 1759/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4204 - acc: 0.7879 - val_loss: 0.4878 - val_acc: 0.7835\n",
      "Epoch 1760/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4160 - acc: 0.8054 - val_loss: 0.4956 - val_acc: 0.7874\n",
      "Epoch 1761/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4145 - acc: 0.7879 - val_loss: 0.4948 - val_acc: 0.7638\n",
      "Epoch 1762/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4052 - acc: 0.8016 - val_loss: 0.4876 - val_acc: 0.7756\n",
      "Epoch 1763/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4089 - acc: 0.8016 - val_loss: 0.4952 - val_acc: 0.7677\n",
      "Epoch 1764/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4089 - acc: 0.7996 - val_loss: 0.4930 - val_acc: 0.7677\n",
      "Epoch 1765/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4113 - acc: 0.8054 - val_loss: 0.4947 - val_acc: 0.7835\n",
      "Epoch 1766/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4142 - acc: 0.7957 - val_loss: 0.4950 - val_acc: 0.7677\n",
      "Epoch 1767/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4222 - acc: 0.7860 - val_loss: 0.4984 - val_acc: 0.7441\n",
      "Epoch 1768/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.4099 - acc: 0.7977 - val_loss: 0.4915 - val_acc: 0.7874\n",
      "Epoch 1769/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4439 - acc: 0.7704 - val_loss: 0.4877 - val_acc: 0.7756\n",
      "Epoch 1770/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4324 - acc: 0.7957 - val_loss: 0.4950 - val_acc: 0.8031\n",
      "Epoch 1771/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4296 - acc: 0.7840 - val_loss: 0.4936 - val_acc: 0.7795\n",
      "Epoch 1772/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 129us/step - loss: 0.4307 - acc: 0.7879 - val_loss: 0.4872 - val_acc: 0.7638\n",
      "Epoch 1773/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4270 - acc: 0.7860 - val_loss: 0.4929 - val_acc: 0.7441\n",
      "Epoch 1774/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4191 - acc: 0.7938 - val_loss: 0.4922 - val_acc: 0.7874\n",
      "Epoch 1775/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4135 - acc: 0.7899 - val_loss: 0.4955 - val_acc: 0.7598\n",
      "Epoch 1776/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4100 - acc: 0.7977 - val_loss: 0.5064 - val_acc: 0.7402\n",
      "Epoch 1777/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4243 - acc: 0.8016 - val_loss: 0.4866 - val_acc: 0.7756\n",
      "Epoch 1778/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4312 - acc: 0.7879 - val_loss: 0.4856 - val_acc: 0.7835\n",
      "Epoch 1779/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4086 - acc: 0.7957 - val_loss: 0.4904 - val_acc: 0.7598\n",
      "Epoch 1780/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4247 - acc: 0.7840 - val_loss: 0.4889 - val_acc: 0.7913\n",
      "Epoch 1781/2000\n",
      "514/514 [==============================] - 0s 95us/step - loss: 0.4135 - acc: 0.7977 - val_loss: 0.4849 - val_acc: 0.7835\n",
      "Epoch 1782/2000\n",
      "514/514 [==============================] - 0s 99us/step - loss: 0.4193 - acc: 0.7879 - val_loss: 0.4879 - val_acc: 0.7992\n",
      "Epoch 1783/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4215 - acc: 0.7879 - val_loss: 0.4924 - val_acc: 0.7559\n",
      "Epoch 1784/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4170 - acc: 0.8016 - val_loss: 0.4986 - val_acc: 0.7559\n",
      "Epoch 1785/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4207 - acc: 0.7918 - val_loss: 0.4912 - val_acc: 0.7441\n",
      "Epoch 1786/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4629 - acc: 0.7568 - val_loss: 0.5131 - val_acc: 0.7913\n",
      "Epoch 1787/2000\n",
      "514/514 [==============================] - 0s 145us/step - loss: 0.4380 - acc: 0.7879 - val_loss: 0.4863 - val_acc: 0.7795\n",
      "Epoch 1788/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4191 - acc: 0.7996 - val_loss: 0.5162 - val_acc: 0.7362\n",
      "Epoch 1789/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4629 - acc: 0.7626 - val_loss: 0.5247 - val_acc: 0.7913\n",
      "Epoch 1790/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4374 - acc: 0.7840 - val_loss: 0.4946 - val_acc: 0.7559\n",
      "Epoch 1791/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4086 - acc: 0.8035 - val_loss: 0.5025 - val_acc: 0.7992\n",
      "Epoch 1792/2000\n",
      "514/514 [==============================] - 0s 100us/step - loss: 0.4602 - acc: 0.7588 - val_loss: 0.4935 - val_acc: 0.7559\n",
      "Epoch 1793/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4162 - acc: 0.7918 - val_loss: 0.4944 - val_acc: 0.7480\n",
      "Epoch 1794/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.5878 - acc: 0.6868 - val_loss: 0.4784 - val_acc: 0.7913\n",
      "Epoch 1795/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4928 - acc: 0.7451 - val_loss: 0.4722 - val_acc: 0.7638\n",
      "Epoch 1796/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4425 - acc: 0.7860 - val_loss: 0.4775 - val_acc: 0.7717\n",
      "Epoch 1797/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4341 - acc: 0.7802 - val_loss: 0.4780 - val_acc: 0.7677\n",
      "Epoch 1798/2000\n",
      "514/514 [==============================] - 0s 337us/step - loss: 0.4390 - acc: 0.7840 - val_loss: 0.4710 - val_acc: 0.7795\n",
      "Epoch 1799/2000\n",
      "514/514 [==============================] - 0s 89us/step - loss: 0.4272 - acc: 0.7957 - val_loss: 0.4682 - val_acc: 0.7835\n",
      "Epoch 1800/2000\n",
      "514/514 [==============================] - 0s 91us/step - loss: 0.4261 - acc: 0.7957 - val_loss: 0.4706 - val_acc: 0.7795\n",
      "Epoch 1801/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4281 - acc: 0.7840 - val_loss: 0.4767 - val_acc: 0.7598\n",
      "Epoch 1802/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4247 - acc: 0.8016 - val_loss: 0.4715 - val_acc: 0.7795\n",
      "Epoch 1803/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4298 - acc: 0.8016 - val_loss: 0.4709 - val_acc: 0.7717\n",
      "Epoch 1804/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4197 - acc: 0.8054 - val_loss: 0.4771 - val_acc: 0.7795\n",
      "Epoch 1805/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4178 - acc: 0.8054 - val_loss: 0.4802 - val_acc: 0.7756\n",
      "Epoch 1806/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4215 - acc: 0.7918 - val_loss: 0.4811 - val_acc: 0.7677\n",
      "Epoch 1807/2000\n",
      "514/514 [==============================] - 0s 167us/step - loss: 0.4138 - acc: 0.7821 - val_loss: 0.4862 - val_acc: 0.7520\n",
      "Epoch 1808/2000\n",
      "514/514 [==============================] - 0s 149us/step - loss: 0.4385 - acc: 0.8016 - val_loss: 0.4901 - val_acc: 0.7992\n",
      "Epoch 1809/2000\n",
      "514/514 [==============================] - 0s 89us/step - loss: 0.4329 - acc: 0.7938 - val_loss: 0.5083 - val_acc: 0.7283\n",
      "Epoch 1810/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4305 - acc: 0.7918 - val_loss: 0.4858 - val_acc: 0.7874\n",
      "Epoch 1811/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4151 - acc: 0.7938 - val_loss: 0.4812 - val_acc: 0.7677\n",
      "Epoch 1812/2000\n",
      "514/514 [==============================] - 0s 334us/step - loss: 0.4208 - acc: 0.8016 - val_loss: 0.4821 - val_acc: 0.7874\n",
      "Epoch 1813/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4160 - acc: 0.7879 - val_loss: 0.4913 - val_acc: 0.7598\n",
      "Epoch 1814/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4120 - acc: 0.7977 - val_loss: 0.4847 - val_acc: 0.7874\n",
      "Epoch 1815/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4144 - acc: 0.7938 - val_loss: 0.4843 - val_acc: 0.7795\n",
      "Epoch 1816/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4124 - acc: 0.7840 - val_loss: 0.4855 - val_acc: 0.7717\n",
      "Epoch 1817/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4227 - acc: 0.7840 - val_loss: 0.4861 - val_acc: 0.8031\n",
      "Epoch 1818/2000\n",
      "514/514 [==============================] - 0s 89us/step - loss: 0.4151 - acc: 0.7918 - val_loss: 0.4911 - val_acc: 0.7598\n",
      "Epoch 1819/2000\n",
      "514/514 [==============================] - 0s 91us/step - loss: 0.4144 - acc: 0.7996 - val_loss: 0.4787 - val_acc: 0.7795\n",
      "Epoch 1820/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4193 - acc: 0.7860 - val_loss: 0.5063 - val_acc: 0.7362\n",
      "Epoch 1821/2000\n",
      "514/514 [==============================] - 0s 119us/step - loss: 0.4195 - acc: 0.7918 - val_loss: 0.4838 - val_acc: 0.7874\n",
      "Epoch 1822/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4095 - acc: 0.7938 - val_loss: 0.4874 - val_acc: 0.7677\n",
      "Epoch 1823/2000\n",
      "514/514 [==============================] - 0s 161us/step - loss: 0.4165 - acc: 0.7840 - val_loss: 0.4894 - val_acc: 0.7480\n",
      "Epoch 1824/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4284 - acc: 0.7802 - val_loss: 0.4893 - val_acc: 0.7795\n",
      "Epoch 1825/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4096 - acc: 0.7996 - val_loss: 0.4892 - val_acc: 0.7717\n",
      "Epoch 1826/2000\n",
      "514/514 [==============================] - 0s 143us/step - loss: 0.4117 - acc: 0.7977 - val_loss: 0.4900 - val_acc: 0.7756\n",
      "Epoch 1827/2000\n",
      "514/514 [==============================] - 0s 189us/step - loss: 0.4275 - acc: 0.8054 - val_loss: 0.5040 - val_acc: 0.7441\n",
      "Epoch 1828/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4127 - acc: 0.7918 - val_loss: 0.4893 - val_acc: 0.7598\n",
      "Epoch 1829/2000\n",
      "514/514 [==============================] - 0s 353us/step - loss: 0.4153 - acc: 0.7996 - val_loss: 0.5006 - val_acc: 0.7913\n",
      "Epoch 1830/2000\n",
      "514/514 [==============================] - 0s 544us/step - loss: 0.4252 - acc: 0.7860 - val_loss: 0.5056 - val_acc: 0.7323\n",
      "Epoch 1831/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4253 - acc: 0.7996 - val_loss: 0.4872 - val_acc: 0.7638\n",
      "Epoch 1832/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4161 - acc: 0.7899 - val_loss: 0.4931 - val_acc: 0.7874\n",
      "Epoch 1833/2000\n",
      "514/514 [==============================] - 0s 89us/step - loss: 0.4181 - acc: 0.7918 - val_loss: 0.4978 - val_acc: 0.7559\n",
      "Epoch 1834/2000\n",
      "514/514 [==============================] - 0s 80us/step - loss: 0.4200 - acc: 0.8054 - val_loss: 0.5015 - val_acc: 0.7795\n",
      "Epoch 1835/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4251 - acc: 0.8016 - val_loss: 0.4976 - val_acc: 0.7559\n",
      "Epoch 1836/2000\n",
      "514/514 [==============================] - 0s 93us/step - loss: 0.4132 - acc: 0.8016 - val_loss: 0.4999 - val_acc: 0.7559\n",
      "Epoch 1837/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4094 - acc: 0.7996 - val_loss: 0.4983 - val_acc: 0.7835\n",
      "Epoch 1838/2000\n",
      "514/514 [==============================] - 0s 96us/step - loss: 0.4181 - acc: 0.7957 - val_loss: 0.4926 - val_acc: 0.7756\n",
      "Epoch 1839/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4108 - acc: 0.8113 - val_loss: 0.4937 - val_acc: 0.7835\n",
      "Epoch 1840/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4128 - acc: 0.7879 - val_loss: 0.4925 - val_acc: 0.7717\n",
      "Epoch 1841/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4151 - acc: 0.8035 - val_loss: 0.5022 - val_acc: 0.7913\n",
      "Epoch 1842/2000\n",
      "514/514 [==============================] - 0s 94us/step - loss: 0.4057 - acc: 0.7977 - val_loss: 0.4986 - val_acc: 0.7795\n",
      "Epoch 1843/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4095 - acc: 0.7840 - val_loss: 0.5008 - val_acc: 0.7559\n",
      "Epoch 1844/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4237 - acc: 0.7938 - val_loss: 0.5135 - val_acc: 0.7913\n",
      "Epoch 1845/2000\n",
      "514/514 [==============================] - 0s 97us/step - loss: 0.4166 - acc: 0.8035 - val_loss: 0.4986 - val_acc: 0.7756\n",
      "Epoch 1846/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4091 - acc: 0.7918 - val_loss: 0.5039 - val_acc: 0.7598\n",
      "Epoch 1847/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4169 - acc: 0.8016 - val_loss: 0.4959 - val_acc: 0.7559\n",
      "Epoch 1848/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4087 - acc: 0.8016 - val_loss: 0.5078 - val_acc: 0.7480\n",
      "Epoch 1849/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4184 - acc: 0.7957 - val_loss: 0.5228 - val_acc: 0.7913\n",
      "Epoch 1850/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4490 - acc: 0.7840 - val_loss: 0.4940 - val_acc: 0.7441\n",
      "Epoch 1851/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4244 - acc: 0.7996 - val_loss: 0.4968 - val_acc: 0.7953\n",
      "Epoch 1852/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4272 - acc: 0.7743 - val_loss: 0.5024 - val_acc: 0.7756\n",
      "Epoch 1853/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4145 - acc: 0.7918 - val_loss: 0.5022 - val_acc: 0.7520\n",
      "Epoch 1854/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4099 - acc: 0.7938 - val_loss: 0.4929 - val_acc: 0.7598\n",
      "Epoch 1855/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4117 - acc: 0.7899 - val_loss: 0.4938 - val_acc: 0.7677\n",
      "Epoch 1856/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4102 - acc: 0.7899 - val_loss: 0.5053 - val_acc: 0.7874\n",
      "Epoch 1857/2000\n",
      "514/514 [==============================] - 0s 104us/step - loss: 0.4130 - acc: 0.7977 - val_loss: 0.5022 - val_acc: 0.7402\n",
      "Epoch 1858/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4312 - acc: 0.7938 - val_loss: 0.4955 - val_acc: 0.7874\n",
      "Epoch 1859/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4075 - acc: 0.7918 - val_loss: 0.4989 - val_acc: 0.7795\n",
      "Epoch 1860/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4041 - acc: 0.7957 - val_loss: 0.5187 - val_acc: 0.7441\n",
      "Epoch 1861/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4209 - acc: 0.7899 - val_loss: 0.5006 - val_acc: 0.7717\n",
      "Epoch 1862/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4106 - acc: 0.8016 - val_loss: 0.5146 - val_acc: 0.7520\n",
      "Epoch 1863/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4180 - acc: 0.7918 - val_loss: 0.5081 - val_acc: 0.7874\n",
      "Epoch 1864/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.4120 - acc: 0.8054 - val_loss: 0.5035 - val_acc: 0.7874\n",
      "Epoch 1865/2000\n",
      "514/514 [==============================] - 0s 113us/step - loss: 0.4171 - acc: 0.7918 - val_loss: 0.5023 - val_acc: 0.7835\n",
      "Epoch 1866/2000\n",
      "514/514 [==============================] - 0s 107us/step - loss: 0.4168 - acc: 0.7899 - val_loss: 0.4980 - val_acc: 0.7677\n",
      "Epoch 1867/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.4221 - acc: 0.7879 - val_loss: 0.5021 - val_acc: 0.7717\n",
      "Epoch 1868/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4196 - acc: 0.7977 - val_loss: 0.4949 - val_acc: 0.7677\n",
      "Epoch 1869/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4055 - acc: 0.7977 - val_loss: 0.5102 - val_acc: 0.7953\n",
      "Epoch 1870/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4445 - acc: 0.7879 - val_loss: 0.5235 - val_acc: 0.7283\n",
      "Epoch 1871/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4408 - acc: 0.7860 - val_loss: 0.4923 - val_acc: 0.7717\n",
      "Epoch 1872/2000\n",
      "514/514 [==============================] - 0s 143us/step - loss: 0.4160 - acc: 0.8035 - val_loss: 0.4974 - val_acc: 0.7756\n",
      "Epoch 1873/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4239 - acc: 0.8035 - val_loss: 0.5044 - val_acc: 0.7874\n",
      "Epoch 1874/2000\n",
      "514/514 [==============================] - 0s 189us/step - loss: 0.4288 - acc: 0.7918 - val_loss: 0.4910 - val_acc: 0.7756\n",
      "Epoch 1875/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4280 - acc: 0.7996 - val_loss: 0.4989 - val_acc: 0.7559\n",
      "Epoch 1876/2000\n",
      "514/514 [==============================] - 0s 288us/step - loss: 0.4132 - acc: 0.7938 - val_loss: 0.4947 - val_acc: 0.7677\n",
      "Epoch 1877/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4103 - acc: 0.7977 - val_loss: 0.4978 - val_acc: 0.7795\n",
      "Epoch 1878/2000\n",
      "514/514 [==============================] - 0s 124us/step - loss: 0.4088 - acc: 0.7977 - val_loss: 0.5055 - val_acc: 0.7480\n",
      "Epoch 1879/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4097 - acc: 0.7957 - val_loss: 0.5068 - val_acc: 0.7874\n",
      "Epoch 1880/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4084 - acc: 0.7977 - val_loss: 0.5027 - val_acc: 0.7677\n",
      "Epoch 1881/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4101 - acc: 0.7899 - val_loss: 0.5102 - val_acc: 0.7559\n",
      "Epoch 1882/2000\n",
      "514/514 [==============================] - 0s 152us/step - loss: 0.4173 - acc: 0.8054 - val_loss: 0.5515 - val_acc: 0.6929\n",
      "Epoch 1883/2000\n",
      "514/514 [==============================] - 0s 130us/step - loss: 0.4354 - acc: 0.7860 - val_loss: 0.5165 - val_acc: 0.7992\n",
      "Epoch 1884/2000\n",
      "514/514 [==============================] - 0s 145us/step - loss: 0.4615 - acc: 0.7821 - val_loss: 0.4938 - val_acc: 0.7559\n",
      "Epoch 1885/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.4097 - acc: 0.7938 - val_loss: 0.4987 - val_acc: 0.7874\n",
      "Epoch 1886/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4137 - acc: 0.7860 - val_loss: 0.5142 - val_acc: 0.7480\n",
      "Epoch 1887/2000\n",
      "514/514 [==============================] - 0s 206us/step - loss: 0.4136 - acc: 0.8035 - val_loss: 0.4996 - val_acc: 0.7874\n",
      "Epoch 1888/2000\n",
      "514/514 [==============================] - 0s 160us/step - loss: 0.4276 - acc: 0.8035 - val_loss: 0.5091 - val_acc: 0.7874\n",
      "Epoch 1889/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4234 - acc: 0.8113 - val_loss: 0.5070 - val_acc: 0.7480\n",
      "Epoch 1890/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 128us/step - loss: 0.4141 - acc: 0.8054 - val_loss: 0.4983 - val_acc: 0.7795\n",
      "Epoch 1891/2000\n",
      "514/514 [==============================] - 0s 156us/step - loss: 0.4389 - acc: 0.7821 - val_loss: 0.4957 - val_acc: 0.7953\n",
      "Epoch 1892/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4285 - acc: 0.7821 - val_loss: 0.5110 - val_acc: 0.7795\n",
      "Epoch 1893/2000\n",
      "514/514 [==============================] - 0s 235us/step - loss: 0.4235 - acc: 0.8093 - val_loss: 0.5040 - val_acc: 0.7598\n",
      "Epoch 1894/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4332 - acc: 0.7802 - val_loss: 0.5126 - val_acc: 0.7874\n",
      "Epoch 1895/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4156 - acc: 0.7996 - val_loss: 0.5041 - val_acc: 0.7480\n",
      "Epoch 1896/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4205 - acc: 0.7957 - val_loss: 0.4988 - val_acc: 0.7835\n",
      "Epoch 1897/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4147 - acc: 0.7840 - val_loss: 0.5117 - val_acc: 0.7913\n",
      "Epoch 1898/2000\n",
      "514/514 [==============================] - 0s 377us/step - loss: 0.4067 - acc: 0.7860 - val_loss: 0.5083 - val_acc: 0.7835\n",
      "Epoch 1899/2000\n",
      "514/514 [==============================] - 0s 372us/step - loss: 0.4114 - acc: 0.7938 - val_loss: 0.5104 - val_acc: 0.7638\n",
      "Epoch 1900/2000\n",
      "514/514 [==============================] - 0s 331us/step - loss: 0.4097 - acc: 0.7977 - val_loss: 0.5024 - val_acc: 0.7756\n",
      "Epoch 1901/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4107 - acc: 0.7957 - val_loss: 0.5166 - val_acc: 0.7480\n",
      "Epoch 1902/2000\n",
      "514/514 [==============================] - 0s 252us/step - loss: 0.4248 - acc: 0.7821 - val_loss: 0.5028 - val_acc: 0.7677\n",
      "Epoch 1903/2000\n",
      "514/514 [==============================] - 0s 318us/step - loss: 0.4289 - acc: 0.7918 - val_loss: 0.4966 - val_acc: 0.7795\n",
      "Epoch 1904/2000\n",
      "514/514 [==============================] - 0s 105us/step - loss: 0.4142 - acc: 0.7957 - val_loss: 0.4944 - val_acc: 0.7795\n",
      "Epoch 1905/2000\n",
      "514/514 [==============================] - 0s 80us/step - loss: 0.4152 - acc: 0.7918 - val_loss: 0.4980 - val_acc: 0.7835\n",
      "Epoch 1906/2000\n",
      "514/514 [==============================] - 0s 92us/step - loss: 0.4727 - acc: 0.7704 - val_loss: 0.5177 - val_acc: 0.7283\n",
      "Epoch 1907/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4235 - acc: 0.8054 - val_loss: 0.4838 - val_acc: 0.7598\n",
      "Epoch 1908/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4323 - acc: 0.7879 - val_loss: 0.4969 - val_acc: 0.7953\n",
      "Epoch 1909/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4321 - acc: 0.7977 - val_loss: 0.4835 - val_acc: 0.7835\n",
      "Epoch 1910/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4437 - acc: 0.7802 - val_loss: 0.5058 - val_acc: 0.7402\n",
      "Epoch 1911/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4435 - acc: 0.7840 - val_loss: 0.4856 - val_acc: 0.7835\n",
      "Epoch 1912/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.4391 - acc: 0.7763 - val_loss: 0.4893 - val_acc: 0.7795\n",
      "Epoch 1913/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4156 - acc: 0.7879 - val_loss: 0.4991 - val_acc: 0.7638\n",
      "Epoch 1914/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4137 - acc: 0.8016 - val_loss: 0.4944 - val_acc: 0.7874\n",
      "Epoch 1915/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4038 - acc: 0.8035 - val_loss: 0.4957 - val_acc: 0.7795\n",
      "Epoch 1916/2000\n",
      "514/514 [==============================] - 0s 108us/step - loss: 0.4056 - acc: 0.7977 - val_loss: 0.5003 - val_acc: 0.7795\n",
      "Epoch 1917/2000\n",
      "514/514 [==============================] - 0s 106us/step - loss: 0.4330 - acc: 0.7996 - val_loss: 0.5057 - val_acc: 0.7480\n",
      "Epoch 1918/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4104 - acc: 0.8093 - val_loss: 0.5036 - val_acc: 0.7835\n",
      "Epoch 1919/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4076 - acc: 0.8074 - val_loss: 0.5044 - val_acc: 0.7677\n",
      "Epoch 1920/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4020 - acc: 0.8035 - val_loss: 0.5097 - val_acc: 0.7795\n",
      "Epoch 1921/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4126 - acc: 0.7996 - val_loss: 0.5175 - val_acc: 0.7480\n",
      "Epoch 1922/2000\n",
      "514/514 [==============================] - 0s 86us/step - loss: 0.4254 - acc: 0.7821 - val_loss: 0.5776 - val_acc: 0.6929\n",
      "Epoch 1923/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4698 - acc: 0.7685 - val_loss: 0.5516 - val_acc: 0.7913\n",
      "Epoch 1924/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4267 - acc: 0.7977 - val_loss: 0.4981 - val_acc: 0.7559\n",
      "Epoch 1925/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4133 - acc: 0.7879 - val_loss: 0.5124 - val_acc: 0.7953\n",
      "Epoch 1926/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4132 - acc: 0.7957 - val_loss: 0.5065 - val_acc: 0.7717\n",
      "Epoch 1927/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4015 - acc: 0.8054 - val_loss: 0.5074 - val_acc: 0.7520\n",
      "Epoch 1928/2000\n",
      "514/514 [==============================] - 0s 120us/step - loss: 0.4114 - acc: 0.8016 - val_loss: 0.5115 - val_acc: 0.7480\n",
      "Epoch 1929/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4166 - acc: 0.7840 - val_loss: 0.5126 - val_acc: 0.7913\n",
      "Epoch 1930/2000\n",
      "514/514 [==============================] - 0s 137us/step - loss: 0.4111 - acc: 0.7996 - val_loss: 0.5147 - val_acc: 0.7913\n",
      "Epoch 1931/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4322 - acc: 0.8074 - val_loss: 0.4963 - val_acc: 0.7638\n",
      "Epoch 1932/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.4334 - acc: 0.7977 - val_loss: 0.5124 - val_acc: 0.7402\n",
      "Epoch 1933/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4224 - acc: 0.7957 - val_loss: 0.4967 - val_acc: 0.7559\n",
      "Epoch 1934/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4109 - acc: 0.8074 - val_loss: 0.4990 - val_acc: 0.7835\n",
      "Epoch 1935/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4012 - acc: 0.8016 - val_loss: 0.5124 - val_acc: 0.7520\n",
      "Epoch 1936/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4185 - acc: 0.7879 - val_loss: 0.5058 - val_acc: 0.7717\n",
      "Epoch 1937/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.4177 - acc: 0.7996 - val_loss: 0.5065 - val_acc: 0.7598\n",
      "Epoch 1938/2000\n",
      "514/514 [==============================] - 0s 131us/step - loss: 0.4124 - acc: 0.8016 - val_loss: 0.4996 - val_acc: 0.7835\n",
      "Epoch 1939/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4081 - acc: 0.7996 - val_loss: 0.5089 - val_acc: 0.7520\n",
      "Epoch 1940/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4016 - acc: 0.8054 - val_loss: 0.5062 - val_acc: 0.7835\n",
      "Epoch 1941/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4060 - acc: 0.7879 - val_loss: 0.5118 - val_acc: 0.7559\n",
      "Epoch 1942/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4056 - acc: 0.8016 - val_loss: 0.5033 - val_acc: 0.7559\n",
      "Epoch 1943/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4074 - acc: 0.8035 - val_loss: 0.5076 - val_acc: 0.7677\n",
      "Epoch 1944/2000\n",
      "514/514 [==============================] - 0s 115us/step - loss: 0.4222 - acc: 0.7938 - val_loss: 0.5175 - val_acc: 0.7441\n",
      "Epoch 1945/2000\n",
      "514/514 [==============================] - 0s 184us/step - loss: 0.4165 - acc: 0.8054 - val_loss: 0.5134 - val_acc: 0.7362\n",
      "Epoch 1946/2000\n",
      "514/514 [==============================] - 0s 175us/step - loss: 0.4453 - acc: 0.7763 - val_loss: 0.5056 - val_acc: 0.7992\n",
      "Epoch 1947/2000\n",
      "514/514 [==============================] - 0s 161us/step - loss: 0.4230 - acc: 0.7996 - val_loss: 0.4971 - val_acc: 0.7953\n",
      "Epoch 1948/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4073 - acc: 0.8016 - val_loss: 0.5051 - val_acc: 0.7480\n",
      "Epoch 1949/2000\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "514/514 [==============================] - 0s 134us/step - loss: 0.4126 - acc: 0.7996 - val_loss: 0.4990 - val_acc: 0.7756\n",
      "Epoch 1950/2000\n",
      "514/514 [==============================] - 0s 185us/step - loss: 0.4023 - acc: 0.7879 - val_loss: 0.5037 - val_acc: 0.7677\n",
      "Epoch 1951/2000\n",
      "514/514 [==============================] - 0s 117us/step - loss: 0.4030 - acc: 0.8016 - val_loss: 0.5060 - val_acc: 0.7638\n",
      "Epoch 1952/2000\n",
      "514/514 [==============================] - 0s 109us/step - loss: 0.4081 - acc: 0.8035 - val_loss: 0.5079 - val_acc: 0.7559\n",
      "Epoch 1953/2000\n",
      "514/514 [==============================] - 0s 98us/step - loss: 0.4146 - acc: 0.8016 - val_loss: 0.5017 - val_acc: 0.7520\n",
      "Epoch 1954/2000\n",
      "514/514 [==============================] - 0s 101us/step - loss: 0.4059 - acc: 0.8016 - val_loss: 0.5025 - val_acc: 0.7795\n",
      "Epoch 1955/2000\n",
      "514/514 [==============================] - 0s 143us/step - loss: 0.4085 - acc: 0.7996 - val_loss: 0.5150 - val_acc: 0.7480\n",
      "Epoch 1956/2000\n",
      "514/514 [==============================] - 0s 193us/step - loss: 0.4123 - acc: 0.8074 - val_loss: 0.5278 - val_acc: 0.7953\n",
      "Epoch 1957/2000\n",
      "514/514 [==============================] - 0s 89us/step - loss: 0.4262 - acc: 0.7840 - val_loss: 0.5033 - val_acc: 0.7441\n",
      "Epoch 1958/2000\n",
      "514/514 [==============================] - 0s 143us/step - loss: 0.4081 - acc: 0.7938 - val_loss: 0.5119 - val_acc: 0.8031\n",
      "Epoch 1959/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4338 - acc: 0.7840 - val_loss: 0.5082 - val_acc: 0.7480\n",
      "Epoch 1960/2000\n",
      "514/514 [==============================] - 0s 103us/step - loss: 0.4119 - acc: 0.8210 - val_loss: 0.4902 - val_acc: 0.7795\n",
      "Epoch 1961/2000\n",
      "514/514 [==============================] - 0s 114us/step - loss: 0.4065 - acc: 0.7899 - val_loss: 0.5030 - val_acc: 0.7835\n",
      "Epoch 1962/2000\n",
      "514/514 [==============================] - 0s 102us/step - loss: 0.4081 - acc: 0.7938 - val_loss: 0.5053 - val_acc: 0.7953\n",
      "Epoch 1963/2000\n",
      "514/514 [==============================] - 0s 128us/step - loss: 0.4690 - acc: 0.7802 - val_loss: 0.5301 - val_acc: 0.7126\n",
      "Epoch 1964/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4278 - acc: 0.7860 - val_loss: 0.5026 - val_acc: 0.7795\n",
      "Epoch 1965/2000\n",
      "514/514 [==============================] - 0s 209us/step - loss: 0.4096 - acc: 0.8054 - val_loss: 0.5069 - val_acc: 0.7835\n",
      "Epoch 1966/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.3996 - acc: 0.8016 - val_loss: 0.5072 - val_acc: 0.7638\n",
      "Epoch 1967/2000\n",
      "514/514 [==============================] - 0s 121us/step - loss: 0.4042 - acc: 0.7996 - val_loss: 0.5124 - val_acc: 0.7795\n",
      "Epoch 1968/2000\n",
      "514/514 [==============================] - 0s 110us/step - loss: 0.3990 - acc: 0.8132 - val_loss: 0.5081 - val_acc: 0.7559\n",
      "Epoch 1969/2000\n",
      "514/514 [==============================] - 0s 116us/step - loss: 0.4118 - acc: 0.7977 - val_loss: 0.5073 - val_acc: 0.7795\n",
      "Epoch 1970/2000\n",
      "514/514 [==============================] - 0s 127us/step - loss: 0.4222 - acc: 0.7996 - val_loss: 0.5024 - val_acc: 0.7835\n",
      "Epoch 1971/2000\n",
      "514/514 [==============================] - 0s 122us/step - loss: 0.4135 - acc: 0.7996 - val_loss: 0.5077 - val_acc: 0.7677\n",
      "Epoch 1972/2000\n",
      "514/514 [==============================] - 0s 184us/step - loss: 0.4038 - acc: 0.7977 - val_loss: 0.5168 - val_acc: 0.7480\n",
      "Epoch 1973/2000\n",
      "514/514 [==============================] - 0s 112us/step - loss: 0.3973 - acc: 0.8113 - val_loss: 0.5183 - val_acc: 0.7638\n",
      "Epoch 1974/2000\n",
      "514/514 [==============================] - 0s 123us/step - loss: 0.4081 - acc: 0.7899 - val_loss: 0.5202 - val_acc: 0.7874\n",
      "Epoch 1975/2000\n",
      "514/514 [==============================] - 0s 111us/step - loss: 0.4147 - acc: 0.7957 - val_loss: 0.5193 - val_acc: 0.7520\n",
      "Epoch 1976/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4130 - acc: 0.7938 - val_loss: 0.5302 - val_acc: 0.7362\n",
      "Epoch 1977/2000\n",
      "514/514 [==============================] - 0s 129us/step - loss: 0.4175 - acc: 0.8093 - val_loss: 0.5109 - val_acc: 0.7756\n",
      "Epoch 1978/2000\n",
      "514/514 [==============================] - 0s 150us/step - loss: 0.4240 - acc: 0.7840 - val_loss: 0.5083 - val_acc: 0.7559\n",
      "Epoch 1979/2000\n",
      "514/514 [==============================] - 0s 135us/step - loss: 0.4090 - acc: 0.7957 - val_loss: 0.5078 - val_acc: 0.7874\n",
      "Epoch 1980/2000\n",
      "514/514 [==============================] - 0s 126us/step - loss: 0.4014 - acc: 0.7996 - val_loss: 0.5083 - val_acc: 0.7559\n",
      "Epoch 1981/2000\n",
      "514/514 [==============================] - 0s 133us/step - loss: 0.3985 - acc: 0.8035 - val_loss: 0.5038 - val_acc: 0.7835\n",
      "Epoch 1982/2000\n",
      "514/514 [==============================] - 0s 132us/step - loss: 0.4422 - acc: 0.7782 - val_loss: 0.4996 - val_acc: 0.7717\n",
      "Epoch 1983/2000\n",
      "514/514 [==============================] - 0s 159us/step - loss: 0.4045 - acc: 0.7996 - val_loss: 0.5051 - val_acc: 0.7677\n",
      "Epoch 1984/2000\n",
      "514/514 [==============================] - 0s 191us/step - loss: 0.4053 - acc: 0.8132 - val_loss: 0.5067 - val_acc: 0.7677\n",
      "Epoch 1985/2000\n",
      "514/514 [==============================] - 0s 141us/step - loss: 0.4105 - acc: 0.7957 - val_loss: 0.5010 - val_acc: 0.7835\n",
      "Epoch 1986/2000\n",
      "514/514 [==============================] - 0s 143us/step - loss: 0.4099 - acc: 0.7977 - val_loss: 0.5063 - val_acc: 0.7756\n",
      "Epoch 1987/2000\n",
      "514/514 [==============================] - 0s 134us/step - loss: 0.3990 - acc: 0.7996 - val_loss: 0.5049 - val_acc: 0.7874\n",
      "Epoch 1988/2000\n",
      "514/514 [==============================] - 0s 276us/step - loss: 0.4013 - acc: 0.7996 - val_loss: 0.5399 - val_acc: 0.7165\n",
      "Epoch 1989/2000\n",
      "514/514 [==============================] - 0s 495us/step - loss: 0.4276 - acc: 0.7957 - val_loss: 0.5336 - val_acc: 0.7283\n",
      "Epoch 1990/2000\n",
      "514/514 [==============================] - 0s 380us/step - loss: 0.4082 - acc: 0.8035 - val_loss: 0.5125 - val_acc: 0.7835\n",
      "Epoch 1991/2000\n",
      "514/514 [==============================] - 0s 353us/step - loss: 0.4124 - acc: 0.8113 - val_loss: 0.5019 - val_acc: 0.7717\n",
      "Epoch 1992/2000\n",
      "514/514 [==============================] - 0s 273us/step - loss: 0.4088 - acc: 0.7957 - val_loss: 0.5133 - val_acc: 0.7913\n",
      "Epoch 1993/2000\n",
      "514/514 [==============================] - 0s 404us/step - loss: 0.4110 - acc: 0.8074 - val_loss: 0.5185 - val_acc: 0.7913\n",
      "Epoch 1994/2000\n",
      "514/514 [==============================] - 0s 412us/step - loss: 0.4153 - acc: 0.7957 - val_loss: 0.5016 - val_acc: 0.7795\n",
      "Epoch 1995/2000\n",
      "514/514 [==============================] - 0s 385us/step - loss: 0.4124 - acc: 0.8035 - val_loss: 0.5242 - val_acc: 0.7953\n",
      "Epoch 1996/2000\n",
      "514/514 [==============================] - 0s 163us/step - loss: 0.4138 - acc: 0.7957 - val_loss: 0.5180 - val_acc: 0.7638\n",
      "Epoch 1997/2000\n",
      "514/514 [==============================] - 0s 125us/step - loss: 0.4003 - acc: 0.7957 - val_loss: 0.5216 - val_acc: 0.7638\n",
      "Epoch 1998/2000\n",
      "514/514 [==============================] - 0s 118us/step - loss: 0.4051 - acc: 0.8035 - val_loss: 0.5181 - val_acc: 0.7795\n",
      "Epoch 1999/2000\n",
      "514/514 [==============================] - 0s 138us/step - loss: 0.3985 - acc: 0.7996 - val_loss: 0.5235 - val_acc: 0.7598\n",
      "Epoch 2000/2000\n",
      "514/514 [==============================] - 0s 148us/step - loss: 0.4140 - acc: 0.8016 - val_loss: 0.5458 - val_acc: 0.8071\n"
     ]
    }
   ],
   "source": [
    "H = model.fit(X_train, y_binary_train, validation_data=(X_test, y_binary_test),epochs = 2000)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 85,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "dict_keys(['val_loss', 'val_acc', 'loss', 'acc'])"
      ]
     },
     "execution_count": 85,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "H.history.keys()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 86,
   "metadata": {},
   "outputs": [],
   "source": [
    "import matplotlib.pyplot as plt\n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 95,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[<matplotlib.lines.Line2D at 0x7f137f059e48>]"
      ]
     },
     "execution_count": 95,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAXcAAAD8CAYAAACMwORRAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvOIA7rQAAIABJREFUeJzt3Xl8E3XeB/DPtxesgIBLV3kQKOyDt7gCuvqgrq6KiOCJriforuDqquCqK554L4qii6iIioqLiAIqcgiIyIocUqDlqNzHUihQCvS+knyfP2aSJk0mk7Rp04mf9+uVV5OZXybfTCefTH7zy0RUFURElFiS4l0AERHFHsOdiCgBMdyJiBIQw52IKAEx3ImIEhDDnYgoATHciYgSEMOdiCgBMdyJiBJQSrweuF27dpqRkRGvhycicqRVq1YdVNV0u3ZxC/eMjAxkZmbG6+GJiBxJRHZF0o7dMkRECYjhTkSUgBjuREQJiOFORJSAGO5ERAmI4U5ElIAY7kRECchx4b55fzHGzN+EgyWV8S6FiKjJcly4b9lfgrHfbcWh0qp4l0JE1GQ5LtyJiMgew52IKAE5NtxV410BEVHT5bhwF4l3BURETZ/jwp2IiOwx3ImIEpBjw13BTnciIiu24S4iHUVkkYjkiMgGERkWos2FIlIoIlnm5amGKRdglzsRkb1IfonJBeBBVV0tIq0ArBKRBaqaU6vdD6raP/YlEhFRtGz33FU1T1VXm9eLAfwMoENDF2aHQyGJiKxF1ecuIhkAzgSwIsTsc0UkW0TmisipMajNooaGWjIRUeKI+AeyRaQlgOkAhqtqUa3ZqwF0VtUSEekH4EsA3UIsYyiAoQDQqVOnOhdNREThRbTnLiKpMIJ9sqrOqD1fVYtUtcS8PgdAqoi0C9Fugqr2UtVe6enp9SydiIisRDJaRgC8D+BnVR1j0eY4sx1E5GxzuQWxLLQ29rkTEVmLpFumN4DbAKwTkSxz2mMAOgGAqo4HMBDA3SLiAlAO4EbVhopfdroTEdmxDXdVXQKbRFXVcQDGxaooIiKqH8d+Q5WIiKw5Ntx5+gEiImuOC3eOcycisue4cCciInsMdyKiBOTYcOc4dyIia44Ld3a5ExHZc1y4ExGRPYY7EVECYrgTESUgx4W7cKA7EZEtx4U7ERHZY7gTESUgx4Y7x7kTEVlzXLizx52IyJ7jwp2IiOw5Ntx5yl8iImuOC3eOhCQisue4cCciInsMdyKiBOTYcOdQSCIia44Ld/a5ExHZc1y4ExGRPYY7EVECcmy4s8udiMia48JdeAICIiJbjgt3IiKyx3AnIkpAjg135UB3IiJLzgt3drkTEdlyXrgTEZEthjsRUQJybLizx52IyJrjwp1d7kRE9hwX7kREZI/hTkSUgBwb7hzmTkRkzTbcRaSjiCwSkRwR2SAiw0K0EREZKyJbRWStiPRomHIB4QndiYhspUTQxgXgQVVdLSKtAKwSkQWqmuPX5nIA3czL7wG8bf4lIqI4sN1zV9U8VV1tXi8G8DOADrWaXQVgkhqWA2gjIu1jXm1gZQ27eCIiB4uqz11EMgCcCWBFrVkdAOz2u52L4DeAmGCnDBGRvYjDXURaApgOYLiqFtXlwURkqIhkikhmfn5+XRZBREQRiCjcRSQVRrBPVtUZIZrsAdDR7/bx5rQAqjpBVXupaq/09PS61EtERBGIZLSMAHgfwM+qOsai2UwAg8xRM+cAKFTVvBjWGYRDIYmIrEUyWqY3gNsArBORLHPaYwA6AYCqjgcwB0A/AFsBlAG4I/alGjgSkojInm24q+oS2BzHVOOXM/4Wq6KIiKh+HPsNVSIisubYcGeXOxGRNceFu3CkOxGRLceFOxER2WO4ExElIMeGO8e5ExFZc1y4c5w7EZE9x4U7ERHZY7gTESUgx4a7stOdiMiS48KdXe5ERPYcF+5ERGTPseHOThkiImvOC3f2yxAR2XJeuBMRkS2GOxFRAnJsuHMkJBGRNceFO0/5S0Rkz3HhTkRE9hjuREQJyLHhrhzpTkRkyXHhzlP+EhHZc1y4ExGRPYY7EVECcm64s8udiMiS48KdXe5ERPYcF+5ERGSP4U5ElIAcG+7scicisua4cBcOdCcisuW4cCciInsMdyKiBOTYcOf53ImIrDku3NnlTkRkz3HhTkRE9hwb7jzlLxGRNceFO3tliIjs2Ya7iEwUkQMist5i/oUiUigiWeblqdiXSURE0UiJoM2HAMYBmBSmzQ+q2j8mFRERUb3Z7rmr6n8AHGqEWqLCoZBERNZi1ed+rohki8hcETnVqpGIDBWRTBHJzM/Pr9MDcSgkEZG9WIT7agCdVfUMAG8A+NKqoapOUNVeqtorPT09Bg9NRESh1DvcVbVIVUvM63MApIpIu3pXRkREdVbvcBeR48Q8VaOInG0us6C+y7XDLnciImu2o2VEZAqACwG0E5FcACMBpAKAqo4HMBDA3SLiAlAO4EbVhjzcyU53IiI7tuGuqjfZzB8HY6gkERE1EY77hmqrHxZh5kfD0Xz3zniXQkTUZDku3JOLCtF931ZIeXm8SyEiarIcF+7en9kTjyfOlRARNV2OC/eabzFxvAwRkRXnhjuznYjIkuPCXX3hznQnIrLiuHAXhjsRkS3HhTsY7kREthwX7ppklsxwJyKy5LhwB4dCEhHZcly4s8+diMie48LdO1pGGO5ERJYcF+7ebpkGPfEkEZHDOS7c2S1DRGTPceHuGy3Dr6gSEVlyXLh7f6yDo2WIiKw5L9y93TIe7rkTEVlxXLhLEs8KSURkx3HhzhOHERHZc1y489wyRET2nBvu7HMnIrLkwHD3njgsvmUQETVlDgx37+kHOBSSiMiKY8Odfe5ERNYcG+48twwRkTXnhXsSzwpJRGTHeeHObhkiIlsODHeeOIyIyI4Dw93cc3dztAwRkRXnhju7ZYiILDku3H0/s8duGSIiS44Ld+65ExHZc2C4G384zp2IyJrjwl04zp2IyJbjwl19Jw5juBMRWXFcuNec8pdDIYmIrNiGu4hMFJEDIrLeYr6IyFgR2Soia0WkR+zL9H88nvKXiMhOJHvuHwLoG2b+5QC6mZehAN6uf1lhcLQMEZEt23BX1f8AOBSmyVUAJqlhOYA2ItI+VgUGER5QJSKyE4s+9w4AdvvdzjWnNQjfD2SDfe5ERFYa9YCqiAwVkUwRyczPz6/TMpKSzZL5G6pERJZiEe57AHT0u328OS2Iqk5Q1V6q2is9Pb1uj2YeUFWOliEishSLcJ8JYJA5auYcAIWqmheD5YaU5DvjL/fciYispNg1EJEpAC4E0E5EcgGMBJAKAKo6HsAcAP0AbAVQBuCOhioWAMRMd55+gIjImm24q+pNNvMVwN9iVpEd72+osluGiMiS476hmpTELzEREdlxXLgL99yJiGw5L9yTkwGwz52IKBznhXsSTxxGRGTHweHOPXciIivOC3ffWSG5505EZMVx4Z5k7rmzy52IyJrjwl184c49dyIiK84Ld544jIjIlvPC3fslJo6WISKy5Lxw936JiZ3uRESWHBfuScI9dyIiO44Ld+FoGSIiWw4Md+8pf7nnTkRkxYHhzh/IJiKy47xw54nDiIhsOS7ck3jiMCIiWw4Md+8PZHPPnYjIioPDnXvuRERWHBfuaalGn3uVi+FORGTFceHu/YHsympXnAshImq6nBfuZrdMUVl1nAshImq6nBfu5p77zvxiZIyYjae+Wh/ngoiImh7nhbs5zr1D4QEAwKRlu+JZjWN4PIov1+yBy81jFUS/BM4L97Q0AMCtWXMxaeqTcS7GOb5YswfDp2bh/SU74l0K2bnzTuDEE+NdBTmc88LdzwU71yDJ44bL7cH9U9bgq6w9WLatAN9vOhDZAlSBDz8ESksbtM6m4FBpFQAgv7gyzpWQrfffBzZvjncV5HAp8S6gTjZsAE49FQDQsqoco+dtQvNJH+Kz1r/Bjxm/AwDsHHWF/XIWLQLuuANYvhwYP74hKyYialTO3HM/5RTf1dFzXseSLfl4+ZuxmDz1Cfv75ucDI0YAbjdw+LAx7UCEe/oAsHs3cNddQDVH6xAlDJcLmDs33lXElDPDHQA2bQIAXLZlOWYP/0Pk97v/fuCll4A5c4x/KACkRPEBZsgQYMIE4LvvoiiWiJq0UaOAfv0SKuCdG+4nnBBy8tm7jaGR/5iWHThDFZg2DSguNm5XV9eEe2pq5I/Ls1ESJZ5t24y/+/bFt44Ycm64A0BJSdCkzz4ZgY5H9sHzwYeBMxYuBK6/Hpg927jt8dRtz70u3G7gnnuAHZGNVHn94Tfw0VtfNmxNVk4+GXj55dDzzE9LTd7rrwP9+8e7isitWwdUVMS7Ckowzg73Fi3gHvl00OQf3rkTr8x53XjBuN1GsB85EtjI46npN48m3CPdcy8vNw7W7t4N/PQT8PbbwC23RHTX4a/cj8F/uybymqK042ApPvjR4o1m40bgkUeCp3/9NXDSScBnnzVYXTHzwAM1b+KxpgqMHVvzCbCWtblHUFQRxfGYggKge3dj+GM4s2YZI2hqb8fRmDUruuNLv0QJ9Mnc2eEOIPnpkZbzKrv/DpWjXwUuuQRlb70TOFMVqDKGByI11djoL7kEz3/wPTJGzMZVb/4Y/oFFjPuUl4eeP2WKMczy2WdrNpjycuDgwaCm+4sqfEMVkZUV/nHDKSiwPNDb7Zvp2PlSf7Q8lI+LXvkez3ydg0qXO/Jlr11r/M3ODt/OtHFfETJGzMaPW4Ofb20ej9Y8/3grLQW++grIyQk9f/58YNgwYPjwoFmqiivH/YjbJ/4U+eN5P33+8EP4dgMGGGPf27atW9dBWZmxjL59o79vY5oyBfj88/BtSktrtkey5PhwBwBs3x5ycrMtm9DsUWMv9KhF3wbMU7cb1WVGMBe7gJLRrwELF+Koie8BALJ3W+wheU81vHIlcOyxqD7f4mDuoUPG31atasI9KwtITzdeaH4h3P+xz3HuU7OMG336hHumNfbvN/Yg/fc02rUDbr01ZPMT50wDAGxZsto3LaKdFBGsuP3+yGrys3xbAQBg3oYwQVRaChQV4a3vt6LHcwuwrzD+XRN5/3cRcPXVvqG2QcrKjL/e/68fl0dxxt5NKMi2eGOIlby8qJrPWrsXny4zP6lt2RI4s6l9x+Pmm4Ebbgjf5oYbgDPOYFeWjcQI9y5djH7LKMgtt2D3LiN4lu4uwicrdxvT7RLP+8J6whh2mbpqJdbmBr8RZO82hlnml1YHp2iLFljdvTcAYNWuw1j55iBMnP6MMc+v7apdh5ExYjZWbC/AD1vy8Xnm7pplDBpk7EGuN8+t433TCdVtoupbbkFJzQvCZfeDJ25jz/73H70ROL2qytizFQG+DDw2UFHtRkmlC95FJ5nnAgqpa1egdWss3Gh0FeQeLrNuO2kScO21vpt7jpQjr9DiU1MdqSrar11p18hylsut+OrjB7F4wtCY1hVNDaHc+8kavDBrQ/CM6dOBli2B1auD5+XmGqPCFi82uhZjbcUKY/tZsiT6+y5aZPx1NcCZYVWNbToBhjonRrgDwGmnAVVVqLz6Wvu2poUrtgIALps/BZdlLwQACMK/cEKdm2XvsuAXx5y1ewEAM9ftQ+mE94Lm99hohMh1by8FAPTeFfwx0zvvwQmL8eGjb+DhaX5tvH2vZWVG2B5/fM28wYMD9ywHDgwMLTMc3O5az9WvK+LPH66Ep9xvz8h8M4Oq8cZi7tkWvTDK12TNfw/jirE/4LSR83xrMVy2e/t/m6UYm2HYc/QPHgx88YXvZu9R3+Hcf4Yfjjp+8TZk7vRbDwsWAJmZxt6qiPFGOGUKyrp2w5h5G+G2erPbuzeig8muaH9A5okngIyM6O4DALffDrz5pm2zDWMn4sA+4/mPnvN6cAPvsL/MzOB5V1xhfJ/jwgvhOvGk2P9m8fz5gTWE4rdTEsC7nt1+3YrTphndkpFwu4EfA7tddx0ydhQOz5wDXHMNMDKwu3fPkXKc/cK32FVQx086W7YYn7YbUeKEOwCkpqLZjGkRd20MWVmz19n5iLEXL37b0sxs80X94ou+aSmbNgYtp+8NF+OMZ+bj6+y9vmlJ5kZZ7VG0+PgjyxpE/QKhd++APvm2ZYUAgGemjcL7059D+6J84xeo/vlPVOaaj7Vjh7HR+H9UnzQJ+Mc/jG6glSuBGTN8s27MnoedLw/AsjcHw62K0koX+r7+H2z6dmlAV8R3Gw+gOtRH9n37gKlTfTe37THeZFbtOoRr3lqKbfnGfbxhEHLPvaoq4HsCaSnGyeC2HSxFYahTOdsEy/RVuVi3MgcVldV47IuaT3Cj5vyM4aNq3hDQpw9w1lk1e6JPPgnceiuO2rEV4xdsDPokc7CkEt9t3A906GAcTPZ34IDRDea312v55gBgyk//RcaI2aio9gukF14I+7wOvTbOuFJV63jEunXAvfeGvS9++gmnDvsLVgy4FVdvWIS+m5cZ0/3WZUmVUcuzs3KCa/c78JpSXoaFP9c6EDtjRsAnqah5twur/+177wFJSXB7X8u5uTUHyb2hXlRkXN+zxxgJd+mlxvL8P8WXlwM7dwYu+/nngfPOqwn4559H55nGNl22Lx8AULEx8PQPM1bl4kBxJT7z//SclQW88kpkz/eEE4COHSNrGyMRhbuI9BWRTSKyVURGhJh/u4jki0iWebE59N+ARIB58+o8quCk/B0YkLMYnQ7n4Z3XPoeefjrw+ONAYWHY+xWWV+O+KWtqyjA32r+umB72fmkuvzBbujRg3po3bkGaqxqdDxvB3bKyDIezc4DHHkOzvblGo5tuCvnxdPuWXODMM4Gzzw6YfnXOYgBA+5ICuDweZO8+guSsNejQ/9KAdvcs+wzNjjs2uOAPPgi4meJxYe66PHyemYsXvxmH8V+8gMs2L8Vxq5Yi1V2N7fklyBgxG6v/a34beM0aoH174OKLfctILzH2Lp/8cj3OeHY+eo+qtUf+7ru+q96fV3zxmzcwIGcxKteux0Xnn4rTzz4Vc66/Gzs+m+VrO+PfD2HJO3cGHxw9+WTjr8fjC5cUjwuuqsA3loF//wjD3lkcvA4A439VUIDdjz2LjfuK4PYoqizOuJm1dgee/NzYNnzn9qm1t6wAVl8zGJXTa96Mjvn7fViwfAtKxr0duoaDBwP2Xg8UGwfmXes3wP3MswCANvl5eH3WqyHv7n0jLatyY92eQmDNGux7/2PsnfoFyqoCD7YXV9Z6073uuppPUvv3B41OKiyrRmF5iDfquXOBvDxUmAfzK6osulaGDAEAJH/7LXD++UYw9u9vPJZ3e+/UCbjxRqP/HTC2rbFjge7dsXbqbDwwNQt63XVGt23XrjUHos3wz1q2Hku3HTTe5E37yo261u8qwL++3QKP+aYnbjeuWf8dxP/TQo8ewMMPh9/5OHy45s2muhrXj1+KnL1F1u1jSVXDXgAkA9gGoCuANADZAE6p1eZ2AOPsluV/6dmzpzaKl17yfrir1+XAlQO1qLjMcv5JD0zTzo/M8j3sZ6ddYrvM/U89r09fPCRsm1tueE5z0jNUAR0waIxe/Je3IqrXe5/al4rkFN/1i0Yv0oWzl9V73XR+ZJbx3GtNn9ftHD3pibna+ZFZ+uiMtao5OWGXcfIDn+vIi4fqn697UvWhh0KvszfeUS0u9t2uvOlm3/U17U8Ivfwff1R1u8M+hyHXPK4Vd90d/rmq6rZ3JgVN7z/oNX3hwjv0tnvHB7T1AfTrE8/Tkx6YpmPmbNDLXlus7gnvBiyjOq1ZyMecdWJv3d//Wuuahg3zPUznR2bp7QNHhn0OrhYtVVV10tIdmnPFDb7pMxatD1zPLdoG3N428DbV7dsDnpMCqi6X6mmnGdfHjlWdNk1VVQcPHKmj/jBYr3zjB91XWK5aVKS6dq3R7rjjdNmfH1AFdPmfhtQs87LL6r0tei/D+j8YvE2OG6eqqp6BA1UB/b5LD13TvltAm/K05gG3ly7OUlXV74Y9UzM9NzdwHQwZonrokOqiRaoLFqju3l3znE4I3CZHXjxUz3rsy3oEmiqATFX7jLVvAJwLYJ7f7UcBPFqrTdMNd1VVj0f1vvvqvcE8celfbdt836WH3jSh/oEZ6jKm9836WJ976rWMw81b+q5fc+toXdrp9HrX9bv7JuuyjqeFnNfniRmqgH59ffi6I33TGtP7Zt3x5Iu+21mXXG17n/2j/6V65Ei9n+foh97Q7HMujajtumN/q199v0G1ujpo+v39H9TDL70a0XKs3qR9l/bttfj+B/RIV4s3tlqX4rRfafk383XV/5yoc074P9/0Tb/uFLjOaoW77+J2G68p7+3S0qA2hVdc6bvef9BrOuO5d4LaVDQ/ShXQpdffGbi8GF1WdjhZe9z778DpY8eqFhZqVd/LI17O6vGTVVV15U131UyfPNnIFL92Lv8QT083nlNVVchlftr9UuP+dRTLcB8I4D2/27fVDnIz3PMArAUwDUBHu+U2arj7q6429uRivDH5Xwbb7D0l2uWlCwY12mNN7DlAJ58R/R7ed39/Lu7rqSlcSlKb128Z//63btpX5Ltdft4F9a7pv62PbZTnXvXqmDrdr2LzloDbq57/l77b66qw9yl88mnVhx+2bjNmTJ0jLNJwF6OtNREZCKCvqt5p3r4NwO9V9V6/Nr8GUKKqlSJyF4A/qeofQyxrKIChANCpU6eeu3bF8VeUKiuBL7+Ep7IKSYMHxa8OIvrF0fPOg9h9cc2CiKxS1V527SI5oLoHgP9h3uPNaT6qWqCq3l+BeA9Az1ALUtUJqtpLVXulp6dH8NANqFkz4E9/QtKg24z30spKYOFCHHniaWjv3sg/uXt86yOihHW4oOEPqkYS7isBdBORLiKSBuBGADP9G4hIe7+bVwL4OXYlNpK0NOCPf0Sb50ZClixBek62EfqbNxtf9tiwAfj0U2P4Wna2MQwOwJETTrH+NqOfI73OxdyPZuNIi9YxLbsqKfqTnn3fpScOt2jju12W2sz4e3l/PH7TU0Htvz7pfDx30V8w6g+3Y3u72Azn+qDnAAy6/hks63R6yPmfnNEXWe27YeFvz6rT8suuMobpPd7nHhSn/Sps29UXhP5hlzcvucN3/eMz+yHfb53VVpGSVocqDR7UDBfd2abmpbSrzXFRLefHzt0jrmPmWf1Q1KI1trf9HxQ2axG27b6Wx+Dt3w8Mmp57dHx30LYdc7x9owa8f6R+Ov6UoGm5FzX8aSBsu2UAQET6AXgdxsiZiar6gog8C6PvZ6aI/BNGqLsAHAJwt6oGDwj306tXL80M9eWJROBdp+G+wVNZaZywrKLC+BThf/IyVWOYnvlj4PGgqhCL+g+VVuGYFjUhkl9cifRWzYLalVS6kJIkaJ4a/DxUFR4FkpNCP0Z5lRuVLjfaHBUcVh6PQgQQkbB1emvbvL8YPTu3RUFpFTbsKURykuDiE9OBpND7NnbLBIDiimpszy/FGR2tAx8w1kFReTXat24OVeBIeTWSRdD6qJrTTPuvC49H4fIo0lKSsHl/Mbq2a4GU5OA6y6pcqHYrjm5ubDciggNFFfjN0c0BGF+2S06SgHXk9qjl+vavpaLag1+lJYdcF26PorzajV+lJgctq9LlRpIIVIHUZAm439YDJdi8vxj9Tm8fcB9VRbVbkZYsQa+X8io3iiqqcaz5nNweRVmVC62ap4asrbatB4rR5qg0NEtJQstmKThSVo22LdLg9ig8qqiodvuW5W1/fNujgrbXSpcbySJITjKeW1FFNVo1S0G1R31tq81hsKt3Hcb//qYlft2yGUorXXhhzs8Yfkk3/KZV8zBrPTqRdstEFO4NIaHDnYiogcSyz52IiByG4U5ElIAY7kRECYjhTkSUgBjuREQJiOFORJSAGO5ERAmI4U5ElIDi9iUmEckHUNczh7UDcNC2VeNrqnUBTbc21hUd1hWdRKyrs6ranvshbuFeHyKSGck3tBpbU60LaLq1sa7osK7o/JLrYrcMEVECYrgTESUgp4b7hHgXYKGp1gU03dpYV3RYV3R+sXU5ss+diIjCc+qeOxERheG4cBeRviKySUS2isiIRn7sjiKySERyRGSDiAwzpz8tIntEJMu89PO7z6NmrZtE5LIGrG2niKwzHz/TnHaMiCwQkS3m37bmdBGRsWZda0WkRwPVdKLfOskSkSIRGR6P9SUiE0XkgIis95sW9foRkcFm+y0iMriB6hotIhvNx/5CRNqY0zNEpNxvvY33u09P8/+/1aw9/K9y1K2uqP9vsX69WtQ11a+mnSKSZU5vzPVllQ3x28Yi+RXtpnKB8UtQ2wB0BZAGIBvAKY34+O0B9DCvtwKwGcApAJ4G8FCI9qeYNTYD0MWsPbmBatsJoF2taS8DGGFeHwHgJfN6PwBzAQiAcwCsaKT/3T4AneOxvgBcAKAHgPV1XT8AjgGw3fzb1rzetgHq6gMgxbz+kl9dGf7tai3nJ7NWMWu/vAHqiur/1hCv11B11Zr/KoCn4rC+rLIhbtuY0/bczwawVVW3q2oVgE8BXNVYD66qeaq62rxeDOO3YjuEuctVAD5V1UpV3QFgK4zn0FiuAvCRef0jAFf7TZ+khuUA2kjg7+A2hIsBbFPVcF9ca7D1par/gfETkLUfL5r1cxmABap6SFUPA1gAoF4/hhmqLlWdr6ou8+ZyGD9Kb8ms7WhVXa5GQkzyey4xqysMq/9bzF+v4eoy975vADAl3DIaaH1ZZUPctjGnhXsHALv9bucifLg2GBHJAHAmgBXmpHvNj1cTvR+90Lj1KoD5IrJKRIaa045V1Tzz+j4Ax8ahLq8bEfiii/f6AqJfP/FYb3+GsYfn1UVE1ojIYhE535zWwaylMeqK5v/W2OvrfAD7VXWL37RGX1+1siFu25jTwr1JEJGWAKYDGK6qRQDeBvBbAL8DkAfjo2FjO09VewC4HMDfROQC/5nmHkpchkaJSBqMH1D/3JzUFNZXgHiuHysi8jiMH52fbE7KA9BJVc8E8HcAn4jI0Y1YUpP7v9VyEwJ3IBp9fYXIBp/G3sacFu57AHT0u328Oa3RiEgqjH/0yQm/AAACC0lEQVTeZFWdAQCqul9V3arqAfAuaroSGq1eVd1j/j0A4Auzhv3e7hbz74HGrst0OYDVqrrfrDHu68sU7fpptPpE5HYA/QHcYoYCzG6PAvP6Khj92SeYNfh33TRIXXX4vzXm+koBcC2AqX71Nur6CpUNiOM25rRwXwmgm4h0MfcGbwQws7Ee3OzTex/Az6o6xm+6f3/1NQC8R/JnArhRRJqJSBcA3WAcyIl1XS1EpJX3OowDcuvNx/cebR8M4Cu/ugaZR+zPAVDo99GxIQTsUcV7ffmJdv3MA9BHRNqaXRJ9zGkxJSJ9AfwDwJWqWuY3PV1Eks3rXWGsn+1mbUUico65jQ7yey6xrCva/1tjvl4vAbBRVX3dLY25vqyyAfHcxupzhDgeFxhHmTfDeBd+vJEf+zwYH6vWAsgyL/0AfAxgnTl9JoD2fvd53Kx1E+p5RD5MXV1hjETIBrDBu14A/BrAQgBbAHwL4BhzugB406xrHYBeDbjOWgAoANDab1qjry8Yby55AKph9GP+pS7rB0Yf+FbzckcD1bUVRr+rdxsbb7a9zvz/ZgFYDWCA33J6wQjbbQDGwfyCYozrivr/FuvXa6i6zOkfAvhrrbaNub6ssiFu2xi/oUpElICc1i1DREQRYLgTESUghjsRUQJiuBMRJSCGOxFRAmK4ExElIIY7EVECYrgTESWg/wcwwssosRRwMwAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.plot(H.history[\"loss\"])\n",
    "plt.plot(H.history[\"val_loss\"], 'r')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 96,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[<matplotlib.lines.Line2D at 0x7f137effd860>]"
      ]
     },
     "execution_count": 96,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAXcAAAD8CAYAAACMwORRAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDMuMC4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvOIA7rQAAIABJREFUeJzt3Xd8FHX6B/DPk4QEQToRkC5FBQGVYi8oKFhA8TzLKaKHWEDUOzTYEOvZz9NDUcFDPZFiOZoKiiD+lEAAUQRBQwcRQg3VkOT5/TGz2dndmd3ZZEtm+bxfr33tzne+M/Ps7O6z3/lOE1UFERGllrRkB0BERLHH5E5ElIKY3ImIUhCTOxFRCmJyJyJKQUzuREQpiMmdiCgFMbkTEaUgJnciohSUkawF169fX1u0aJGsxRMRedLixYu3q2p2pHpJS+4tWrTAokWLkrV4IiJPEpH1buqxW4aIKAUxuRMRpSBXyV1EeonIKhHJF5HhNuObicgcEfleRH4UkUtiHyoREbkVMbmLSDqAUQB6A2gH4DoRaRdU7WEAk1T1FADXAngt1oESEZF7blru3QDkq+oaVS0CMAFA36A6CqCm+boWgN9iFyIREUXLzdEyjQFstAxvAnBaUJ2RAGaJyF0AqgPoEZPoiIioXGK1Q/U6AONUtQmASwC8JyIh8xaRQSKySEQWFRQUxGjRREQUzE1y3wygqWW4iVlm9VcAkwBAVecDqAqgfvCMVPVNVe2iql2ysyMeg09EHrJt7yHMXP677bj8bfswf/WOuC5/ytLN2HvocFyX8eWKrdhaeCiuy4gVN8k9D0AbEWkpIpkwdphODaqzAcCFACAiJ8JI7myax9K6dUCyTvoqKQH+9z8gnvfbLS4GXngBeOMN4Lcwu2ymTgWKigLLliwB1qwxXu/YAcyZEzrdlCmh0znYuPMARs3JR0zvL1xYCMya5R/esAHIy6vYPL/6Cti5E5g9G9i9277Ozz8DP/1UseW4dMOYBbjtvcU4dLgkZFyPl77GdW/lxm3ZP23eg7snLMWDn5TzvX75JTB3LrB6tWMVVcXAdxfhqte/K98yAGMZ27eXf/ooREzuqloMYAiAmQB+hnFUzHIReVxE+pjV/g7gVhH5AcAHAAYo77wdWy1bAl27Rj3ZlKWb8dznK8PWeeiTZZizcptzhVdfBa68Ehg/Purlu/b008B99wG3347tbdrh0Sk2P9LZs4G+fYERIwLLO3cGWrUyXvfoAVxwgfGH5DN3LnDFFcAjj9guevu+P3Dj2AX4afMeAMBf38nD8zNX4bc97lpo7+Wux+tzA5PC7gNFuGVcHrbv+8Mo6N8fuPhiYNMmY7h5c6BbN1fzt3XwIHDhhcCZZxrv+aqr7Ou1awd06OCfrKgEt723CBt3HijXYjfuPIBbxuXhQFFxyLi12/cDAEpKE/vTf21uPt76xvhz37L7oG2dBz9ZhjmrHL7jhYVAz55A9+5A69aOy/G9rU27Apfxbf523Df5h8iBFhUZy7j00sh1Y8BVn7uqfqqqbVW1lao+ZZaNUNWp5usVqnqWqnZS1ZNVdVb4OVZCeXlGggm2ahUwfHhgq7WkBBAxHr+bm6GPPgp8/72RQN59Fxg5Epg+HXjrLeP1kiX+lmBJCfSuu4yWXN26wKefBi5z7FigfXtj2U6mTYOOGYNOj83CBws3AHv2AHfcAezf768zfz5W3f0gXpu7GodLStF+xOf4/pHnjNbvvn1G/bFjcXDsf3DzOJtW5Jo1wLBhwHrzbOff7Te5oQrk5BitxGBPPw3k5gKq0GHDgF9+sZ9Hfn7Zy/oH9uDAG2OM1raVuZ9m78uvYtWjz4bOY8QIYOlSAMC2QssPMNdsMX74IXTECHz9z3H4d8+/Qps2BUaNwoI1O/HNr9sxxkwQ+/8w/hhKSxUYPdr4fCZPBsaNsw39kf/9hGeD/kDfX7ABX63chrH/t9YoMD/LW1/9CvNvGho6k7ffNj4XoOx74tg+ys31f1d935HlywOqXDHqW5z8uOVnOGYMAODrXwowc/lWPDF9hVE+Y4bxHXVj9Gh88szb+GrlNny5Yis0JwdqWa4v+RUXlxrfre7djT8hixMe+cz/x7BjB3DnnUadUaOgHTpA1641hu+8E9i1K2w4qor8bfvw3OerMGXpbxj83US0WWtZDyNHYtb7n6PjyJkYn7sePw8Y7P+Orl8P3HsvUFoaukX62GMoWbwEHUfOxKRF/mNJiktLbeP4y5gFmLx4E1QV+sILKJ33DQa+k4cHP1mG+at3oMXwGdi5v6jst7n3h58wMW9D2PcWE6qalEfnzp21UjE+4tDyVq2M8nXryop2fDnXX/9f/1ItKfEPh3k0z5muny3bos8++d/Q8abf9xz0l7VsGRLfgLcXBAw3z5murR6YoZqTY5S98IKqqm7YsT+gTs6HP2jznOllZf/sMyQktr2HDuvOfX+ULbLk5FOM8T17Bsw7xLZtxviGDQOKrTEsz1uhCujBxk0D6hwuLtGuT36hU9qdZ7/erN5/P2TctsJDttN9OH+1qqoWHizS7TkPhf1cPv3xN22eM11vfSdPN+86oGf+Y7Y2z5mukxdtdIxn/x+HtWDvIVVVbZ4z3Vi3Fi/MXBlY3qGDKqAX3/yq/fszhzfu3F82XfA8g+taH8UNGgR8dmXTW+osWb+zrPyGMbm6fa9/3f22+4D9skxFxf7vePOc6dpp6HhVQHcdXTtkmdtXrfEv99VXA8Y1z5muP2/ZY0wwbJgqoCN63FZWf2uHzqqvvGIM33uvYzyFB4v0sanLA9eVOY9ftxbqwYN/qAJalJauzXOma5fB76kCWtK0qRbsPaQHu55u1M/NVd292/H3esLDnwV85sGfy5bdB8vKgteR9fG/7zfprlWrjfdYvY6OX7A+7PoOB8AidZFjmdz79y/74YV9XHNN2STffvCZv1xEtU6dyNObH/i9E77X7gNHh45fujS0rFkzLWnSNOw83+58eUjZrjPP023VaruKKfix/BjzD+Xcc8PWW/XC60a9Y48NKF/xzfeqqvrT4lUB5f/5eIE/kYx8WrfvPaTzV2/XH7t212+ad3Je1oMPqtaurbprl+rZZ7t+H+O+/FlVVYde+6ir+q2HfRLygwxOjmUPVe3x4tyyH3lZ3eHDjfWhqvl1m7iL9Z13Qsra/u0j47ty6b3l+gwV0FfOuCYk/jtenxsw/O/Trw4YLu7USTfs2K/52/aqLl4cMG7Qkx8HfI9Pvsv/R1tapUpA3dKMjIDhn7fs0Y01s0Pj7NrV3fv56Sfd+uNKVUA3T5sVMG7HUTWjWi8lIrqyfrPo12m3bmWvzxn0lq74bY9unjoz4vILqtXSN7teEVC2oVYDnZS3odwpy21yT9pVISuNd991V2/iROC114C6dfHUzF8ww1euGnHz0SojXVDr0L7QEeZmc4D0dKRtWBt2fjcvnhZSVvu7r13HE6zdtrWY+uE89Jk3L2y9tsPuwCNZzfFE0M7POfc9heO+mYCvv1yE9pbyUbN/wQDzdaORD6LPmqrYVr0ucvPmhA/I1/2wejXwf//n+n1kFB0CNm7EPTPfdFW//dY1WNawNY4tLMDxBeux66gaWFu3sW3d/XmLUbD+N9SCoHTTZrTfuhrbq9UCXnsGADB1ei767NzkLtCnngopOrFgHVbVb46XZvzT3Txs3DV/IiZ17BlQ1vr9wO6XwbmTA4bTf/gB/UZ8jGP27cCM4sBuur3LVpS9PmHbWuyoVrtsWA4HHqEixYH98YMfHo/ZhTbHV7jdobxwIT5881PcCWDvzQMDRtU9WOhuHqY0VRy/vRxdIgsXlr18cO7beHHIBlywOg/XR1h+/QN7cGve/wLKah3ah4x0iT6GaLn5B4jHo9K03KP9B1fVi275d/TTmS2e7i/McT9Ny5blWk6yHzNnzNfL+78UUNb1ztAWajSPZbcMjXvc4069NOHr6vdax9iWf9i+e9I/R+vjumueDBge2O/hpMfk5ceUpZsrkLLYco+PHj1wXkmzck2aUVKMM2dOcj/B2rXlWk6yXXTpGTi2QauAsuO3u7oEtaOT3n6lQtO70ePXhZErxViDPfZHcFy1fE6CI4nOWx8/mewQPK3+ssVAp2Pjugwm92jNno0HyznpgMVT8fCct2MaTmV10tbAQwPfmzTCoWblUe2wN05OIe+r9vMKAJfHdRlH7vXcf/3VOB46gWrb9bVTpVHn0N5kh1BpjZ/4cLJDSCn7DtsfVhlLR25yv/9++zMZiYjireiPuC/iyE3ukoC91URENsR6smGcHDnJ/cCBwEOvtm5NeAiimvBlElHl0+6Y6nFfxpGT3K++GujWDe3vnYw9Bw4D31Xg4j9ERBVQp3pm3Jdx5CR38/otQ7+bgHm/hLlIVhwpu4KICDCOdo+zIye5m25b+DGqLEr88cwAu2WIkmljPfszjpOCyT0G9uwxrrxoMX7Wsrgucmab023Lg0/3TobZraK/bDBRKlh24x3JDiGhUj+5L1kScu2Xlrvie//uWlUr77lhpewaoiNUr05Nkh2CH1vuMWCTzOKd4No1qhHX+VdEz/zkdEkRJVtaZpVkh5BQR2Ry19B7d8dUzSrxmf/gPjnI65LYs2pdaVa+a+0QJVRGjLaoY3HbQrbc4yPuXRMOd2ypqMKq1dH6L1fGZd4V8q9/VWjy0ef9JUaBhHHKKfFfhgcUpcUgwSX4sh0xE6vkXr9+xefB5F5Bjz0GnH9+4pdbEnqD4FgolbTKecTNFVegRc708k2bnY1Xzr3Bff0FC4Djj7cfd3mYCzFdcUV0cXlBhw5RJ6x5LWPwJzd7dsXnkQxRrKuP2nd3HhmL3yCTewWNHGlbnFl82LY8Jk491fUNcPWyy6Kaday3OAqPaxvT+Y28cFD0ExUU4HBJFFs64X4Uxx9vv+4feyw2f7j9+2Nf3eyKzydWPvwQ+PZb//DYsREnaVz7KP9AZjlOpHnY4QJip9sfIZYQ1e3P9rzyhhcCC7p0cT3L1fWa+geuuaY8USVdaid3ByNnu7s7TzQOVMkyXkyfDrRqFb6ySaZNw69zFpQN7962M6ROSdAXUmCT3Oxu7O1CzdWrsPHEk50rhGsJ2xjXpU/Z66WdzvaPcEoIpsMlMWrFHHussf6DDR0KHHNMxMl/u+Oe8BXGjEH1/uXoQmrRIvpp3GjbFujWzT98yy0RJzmhYU3/QNAhwo6s6+7vfw8dP3AgMH++4+Q79ka4lPJJJ7mLA7D/c3/11ZCiA1Wy8H3jE/wFEyfafwdOPNF2Md1PbYGil142Buy6oWr4D5rQbqcFjrvkEtt5BsiOfyMhdZL7zp3Ab7E9xHH4xUPc1+01FPjPf4BGjdx9uCapYtmDb9MCSf/ss7LX+fWa4ugsm03L2rVDyyLofbNx84sMmx/L/hq1Mefhl4ykGOzmm8PO95kn/4tZ42eiJC3dX5iZCXz5JXD33cC0acAbb4RMd3l/m1vKPfAA8P77gWXWeB9/HDjN/GGdf759vC+/bKyf224LGzc6dQr942zdGsjP9w9XqQKJZuvptdeA8eOBBQvwcM87MP2Ec1A6fQYwY4bRvRTBP84fgK87nR95OUuXAt9/7zx+woSylwHhV61qPN9wgxFTY4eTfKwTBX/XJk7073OZPRvYsAGYbDmfIzcX9Y7OCp1nuvn9GDoU+OorYPDggNFq98czyeFGN0cf7X89YwZw5504b5B5S8FOnfzjMjKAzz8PnFYE+NOfygZLzIMtRNKQOXQI8N//AgMH4h/3Bu1XWr4ci8dOxvNDngemW251+cknxnc2Lw8YN84+3vfeA26/3X5cLLm5XVM8HjG/zZ7vpryB96Mq92NPVnV9fNpy1/Unf/hNwKIXtghz02dAS6tWVVXVNfO/VwV0be1GWlpaGlrX8j5OvHey6nffhdaxucmy02Ne85NVgbKbOxd36aIKaNGw+/z1srON5c6ZEzqPzz+3jTH4rvDv9B/uH//FF6Gf16OPlo0/+bGZ2vz+af76AwYYz7//Hvo5zp+vmpNjvN60SfX99/3ldp+72+9Dv3762x13209rHb7X5qbVkyapArru9qBxhYVlswhePyHx9OtnPA/1306wec50ndD9OueY7TjV872+7DLVXr2M177bOK5ebdRZscIYHjUqcPqGDY3nzEz7dWInMzNwfPv2gfO8wrxp9Mcf28Ze/NTT/uFBg4zn3btD32NWlurEicbrq68OXd9vvGGM++EH/3Lq1fNP3769am5u2fAPHc8ynu9/PODtXP/WfP/N6PfudV7vVpb5+h6H0jOc15lLcHmbvdRpuQfdlLeiug1+B49c1i6wsF49x/p/uursgOHOLSNs8po7d3wfQKlIxFbhHxmZwBlnhG6h2E331luhZQCG9rkPnYZ+UDacbh7ZU+WaP/v7b33zi6KV+sW95+LNGzuXDc/rfiW6DHkPc+ctA3r0CJ1ghP/OTFMGn41Xrz/VP27sWKCgAGjQwBjOCmr5PfmkcQvCxo2B668Hfv/dvs93zx77YPv2NZ6vvNK/ZaAa6S0612vSBNi2DRtuv9tftn17wKZ7RDVqGO/5pZcCisu7m2VtfpgbdE+ZYmzpBjvxRGNd3mFzJufevfbTONm505jGZ9EiYPdu/7BvH4j1DVrmL/ff7y//97+B9euBWrUCFvH0xIXAjh3+o9PSbNLZrbcaV4Dt2NFfZl2mCHDaaThYxdiKaVmvGgDgpCahW8NPXDAQuQtWBW4phGOTk04eOsGmYnykTnIPsmVX+a+X/FnbM3HI/LDL1K/vaoeVT5rdF83KTO7pZldAWnp6aJ3TAvvyyro6GjXyF3bqBPQMvMs9AGPn4gUXGDclsWjWsDb2HGVJOr4fWXo60LCh8TpccnfINm0a1MBF7Rta6qVhe/U6KKrrcNiYZf00q1cNl3c61ngfI0YY46yHm733nv+1qrHurP3Yvj+BYDVr2pefd57xfNRRwEUXGc/33YdqVWw+A8DYoTbIZmdxz57GMtq3N/pQ0y1dZkENgZMaO8RiVb++v7vCNKtb78jTWfXoAdx/P1q2CnMdlcxMoE4d/7D1D6tBg9DPWMRIaNZuw2HDjHXnpHr1wCRYtaqRnE86CXjlFfuEbIlJ0tOwqWY2cnrdBVSpYnsuxbB+nY3l2Mxr9t/Pw5xh5xuxu9jfsvtoI5mni29Wob/f0rR0HLauN6snnwz5vaJDh5BqBzOrhpTFS+U9T76C9s35ptzT3nGlzV1SCwqim0mkJpfZd5lm9vEdzKoWWic3N2DwuPo2RwV89x1QrZrxfOaZ/vJq1fyHrD33XFnxoPNaYfC0/MB6gPEDsvtRR3D4gQdhd96fb9JSlw1iAMCsWfblV18dxUzC8CWxd981ntPTjYR64AAAoNaUKfbTTbBpbb34IvC3vwXOPswf+qTbzsDeQ2G2Lh22HM649Gxg6G/GzmI3vvjCXT3A/WaBXb3nn3e/HKtl5nWdfH3fdo0aACKCs+/4D/qf0dxxVpkZ5vr2JXdLnK2yw7Sua9QwtqyA0Fa473OI1DgL9tBDxsMqqHERk3MMopCyyb3pfXclbmHLbC5E5vuinXOOcfTMuHFA166Ye+UtyPtyIYaNfgAAUNyqNZ4/50bkntUbHznNf8kSlM7PxZe3nxc6znfsbnByqGbzZwGE/pgmTjRia9/e2Blmjd33nJkJFBX5p/n2W+DGG4E1a1Alw+HHWfYqmuyeINatFSu3XTOAbcKTdOeEUC0zA9Uyg35uM2caXQ7TptlOs/rpS5AmMLpKymPUKP8f/sCBwJgx9vUive94nPQXrivFlP9Ub6SnuVh2tAn5iy+Ajz4yvtMDBtjPK1bvec4cYMsWoKAAl/7A5B4TUs6zRA/VDOprq1Mn5MJjARo0sD+Uy/dFe/BBYKF5PZeLL8b5D9yO8x/w7ykvBTDqzGvQvK5DMgaAU05BmtMZlk4nZjgc5iYI+tI2bQo88og5UuyfO3c2Wji+VuGZZxrJ/bHHHH8EvuJo8qUrbg/fC8cpubduHXnacG8o2oRw0UXG/pNp02ynDZvYrFtpTu680/+6T5/Q5O423iiOD3fNRXLPcPqzrFUrcH+Kb6vG4bDGEK1ahXRX+pQdMRW0bkJ+N25ZTqL8dfiM8s2jnFKuz3311kK0un8qstatKdf0s4cZx4y3a2RuUq1cGdgy9x26+JFjO9tQ1i9RGjbTlZpl6eVtKQT/ODp2NLpzrP3Q69b5X6eHWY5vXsHJvRwJzfdjiHm73ens1Gj4knvwuhs4sGLzrUhrL5p/wUWLym4+ExPhlr1gQejhqLHgIrk7+uWXwN/khRcCc+cCOTnlDsf3R5rm0HLXGHyTJ912Bp7pF9oPHy8pl9y3PPE87pzvcDysC7XqG3vkbz6rhVFwzDH2LXNfknH6QVsTY5gk6dtU79ikVsi4sIKP2/bNu3r10B07zf39liJpqJbpsOMwWLjk7tuJa7czF0DbhsZO2+waNsc4+2RlASeHOYkqXs44w3gOviRBBTfFy9W6K88yO3cOOXKkXHzfIbsdjr6zMrt1czwDtEL+Yp4MdsIJ4evZsftNnneeY/+9G/WONs7WzfpTP6PA9x0x+U7+qluB2+N1a1kX13ZL3EX2Uq5b5uxRT+LsyNUCDL94CC5fOQ9nrf8RZ7XOxviLTsEZxzkf9ggg8hfJLrnbaFirKj6+80z/loJbr79uPJyW60AlDV/f1x27DhTZjAxqtVjfQ3CCP+uswK2SIEMvaI2zWtVD1xZhulEOHgwba9x07Gi03svTavSJVZ9szPutojBsmPGwey8ffGA84mXAAKB//4p9BjFUtuV86aXGCVVB62R47xPQ66SGaH9sDP5UE6RyrNlKRERwZqv6kc9EbNQI6N3b2CFp5yjzGh77LYdkOvyQT21WB1WDDsMb2O+RSIEGfgE7dwa6dzd20IWbLE2QXSMLbRvYHIMdnNx9Pzxr3MHHCDvISE/DaZH+IIPfQzgvv2ycsRorTknF94fpO6ImWJhkLAJMO+EcvDD4Occ6lUq49R/NZ1NelSSxh7B531XS08I3VCqhlGu5l8czV56E5S+bhx1G+kL7xlepEr7fs00b47m01H/8bhSb0l+2OS1yJauqVY3TuCNx84P11fH9QWVnBx4tkwx33x25TizcfnuFTg2/q29O5K0+q0TdGct39FQsLlebiho1MvZNVUmdG3owuQOAKtofWxNYGcU0kVodI0caX5g//9lo7ZWURL6+CQCsXIlbH/xvFIFEJ9zheiGt0g4djDNd+/Xz7JXxEqlcaTrabhmn66tEcsEFxrVuboji8spHkk8+AT77zDjbOEVU0u2i2Nt34wDnkaWl7n9kvsv0Rupzz8oyLoqUnm4crnjXXe4usXr88TjvvoGYec+57uJx6UffVRrDtRTtjhQYODA2hx+mis7mJRbatQtfL5Z8OzRvuqn8J3SJGJcViOaSCEeSBg1Cj3n3OFfJXUR6icgqEckXkeE24/8pIkvNxy8isttuPsl09JA7jMMa7ViPiY+0mfz++8Z1TeK4+XbD6c1xfMPY/ghHD3kGZ93+dvhKsT6BI1m2bwe2bYvPvG+80fgehTn1PqrD5tys65o1gTVrgDdjf6lqSl0Rk7uIpAMYBaA3gHYArhORgGaLqt6rqier6skAXgXwcTyCrZD09MBjpH0XjwKia7lXrRq/63PH0eHMLGyudQzCdh74jo23XNSrjK/P23oJ1cqqXr34XS9bxPFY+6bmiWgXnBD5WiZRa9myfDfX8JpGjewvXEZRc9Pn3g1AvqquAQARmQCgL4AVDvWvA/BobMJzYf9++4s6BQvuIx82zDj++5VXnI8GSSGuGuXVqjn/yV12WXIP2/OApnWrYckjPVGnWhRbdeW4AmdKi/E9GY5kbpJ7YwAbLcObANgeyiEizQG0BGB72IaIDAIwCACa2VzlrVwmTTJuiBCJ3UWx0oIuPJTSjMTMFBJfUZ/kcs01xkXfnngiPgHRESvWO1SvBfChqtresFJV31TVLqraJTtWm81uz0oLTu5pacZ1VQDjjLcjpFUa1Z2EKP6ysoDRoxNy2zU6srhJ7psBWO4WiyZmmZ1rAcTxtDYbFUnud99t3GT4+uud6xEReZCb5J4HoI2ItBSRTBgJfGpwJRE5AUAdAM53yo0HtzuZ7JJ7ejpw1VXGuBRvuXc07yzTqFbibhZAFcBDFqmCIva5q2qxiAwBMBNAOoC3VXW5iDwO415+vkR/LYAJ5j3+EidWV1Os6PwqucHdW+Oi9g3KLoBElViyrrlDKcXVGaqq+imAT4PKRgQNj4xdWFEoLHRXz67lfgRJTxMmdq+oyq0rqjjvZ7jPPnNXz5fcfcdyByf7FO+WIaIji/eTu4MJbwXtFghO5k53MErRbhkiOrJ4P7nbXK1wx1E1cfoVF/jvcg8E3hkJqNj9M4mIKjnPJ3edPj2krFTSjFxuvfEwW+5EdATxdnJfudL2RtgqgjQR43Ay33XVg28ZF5zcfffP9NUnIvIwTyf3X96ZbFteKhLaAI+U3G+6yRjXsGFsgyQiSgJPJ/e2z9hcvRCAQvyn2Qf3pTsldyKiFOLd5H7PPY6jSiUNDWuaxwoHXw7RN1yBO6UTEVV23k3u//qX46jM0sNITwtK5kzuRHQE8W5yDyN7v+VGUJdeajz7blLtS+5H2BmqRHRkSf0M99JLwIYNxt15gNS5lRwRURipn9wzMvzXbQeAF180umSOPjp5MRERxZn3kvvo0RVrdQ8cCBQX82gZIkpp3kvueXkhRWO79A0Yzul1V6KiISKqlLyX3INsPbouvmrVNaBsYqeLkxQNEVHl4Pm+iYySYixs2h5PdP8rskoO4/pn78HC9icmOywioqTyfnIvLcHh9CoY2+1KAMD9p5+S5IiIiJLP890y6Rp64TAioiOd55P70Mvvw/DeJyQ7DCKiSsXzyf2r1t14nw0ioiCeT+5ERBQqJZK7gk13IiIrzx8tAxiXi2lWtxqOb1gj2aEQEVUKKZHcAWDe/d2THQIRUaWREt0yR1XhtdmJiKxSIrnfeEbzZIdARFSppERyr5KeEm+DiChmmBWJiFKQp5P7/GYdkh0CEVFXxofrAAAMmUlEQVSl5Onk/vy5/ZMdAhFRpeTp5F4qng6fiChumB2JiFIQkzsRUQrydHIvzKqe7BCIiColV8ldRHqJyCoRyReR4Q51/iwiK0RkuYiMj22YoT7vfBHW1GuCv/VsG+9FERF5TsRry4hIOoBRAHoC2AQgT0SmquoKS502AB4AcJaq7hKRY+IVsE9h1zOw7plL470YIiJPctNy7wYgX1XXqGoRgAkA+gbVuRXAKFXdBQCqui22YRIRUTTcJPfGADZahjeZZVZtAbQVkW9FJFdEesUqQCcS7wUQEXlYrC75mwGgDYDzATQBME9EOqjqbmslERkEYBAANGvWLEaLJiKiYG5a7psBNLUMNzHLrDYBmKqqh1V1LYBfYCT7AKr6pqp2UdUu2dnZ5Y0ZAFvuREThuEnueQDaiEhLEckEcC2AqUF1/gej1Q4RqQ+jm2ZNDOMMweROROQsYnJX1WIAQwDMBPAzgEmqulxEHheRPma1mQB2iMgKAHMA3KeqO+IVNBERheeqz11VPwXwaVDZCMtrBfA385EYbLoTETny8BmqzO5ERE48l9xLVZMdAhFRpee55L7it0LjeUthkiMhIqq8PJfcDxaVAAAOFBUnORIiosrLc8nd19Wu7J4hInLkueQuwh2pRESReC+5m8+lyiRPROTEc8mdiIgi81xyZ3udiCgyzyV3Znciosg8l9yZ24mIIvNccod5tIyAh0ISETnxXHJny52IKDLPJXcfZZonInLkueTOc5iIiCLzXnJPdgBERB7gueRORESReS65C9vuREQReS+5m7mdh0ISETnzXHInIqLIvJfcfddzZ/cMEZEjzyV39rkTEUXmweTue2afOxGRE88ldzbciYgi81xy9+V29rkTETnzXHJnTiciisxzyZ25nYgoMg8md6Z3IqJIPJfciYgoMs8ld15+gIgoMs8ldyIiisxzyV3MpjsPhSQicua95J7sAIiIPMBzyZ2IiCLzXnJn052IKCJXyV1EeonIKhHJF5HhNuMHiEiBiCw1HwNjH6q5rHjNmIgohWREqiAi6QBGAegJYBOAPBGZqqorgqpOVNUhcYgxMB7z+aRGNeK9KCIiz3LTcu8GIF9V16hqEYAJAPrGN6zILj/52GSHQERUablJ7o0BbLQMbzLLgl0lIj+KyIci0jQm0dnwnbrkOySSiIhCxWqH6jQALVS1I4AvALxjV0lEBonIIhFZVFBQUKEF8hozRETO3CT3zQCsLfEmZlkZVd2hqn+Yg2MAdLabkaq+qapdVLVLdnZ2eeIlIiIX3CT3PABtRKSliGQCuBbAVGsFEWlkGewD4OfYheiADXciIkcRj5ZR1WIRGQJgJoB0AG+r6nIReRzAIlWdCmCoiPQBUAxgJ4AB8QqYlwsjIoosYnIHAFX9FMCnQWUjLK8fAPBAbENzCsZ4EmWaJyJy4r0zVH3YLUNE5MjDyZ3ZnYjIiWeTO1M7EZEzzyZ3IiJy5rnkzt2oRESReS65+7BbhojImWeTOxEROfNucufRMkREjjyX3JUnLxERReS55O7DdjsRkTPvJndmdyIiR55N7kRE5MzDyZ1NdyIiJ55L7tydSkQUmeeSO7M7EVFk3kvuJu5QJSJy5tnkTkREzjyb3NlwJyJy5tnkTkREzjyX3JV7VImIIvJccvdhtwwRkTPPJnciInLmueQuvmMg2XQnInLkueR+fIMaAICsjPQkR0JEVHl5LrmX4XXdiYgceTe5ExGRI+8md15/gIjIkXeTOxEROWJyJyJKQUzuREQpiMmdiCgFeTe581BIIiJH3k3uRETkyLvJnYdCEhE58m5yJyIiR66Su4j0EpFVIpIvIsPD1LtKRFREusQuRCIiilbE5C4i6QBGAegNoB2A60SknU29GgDuBrAg1kESEVF03LTcuwHIV9U1qloEYAKAvjb1ngDwLIBDMYyPiIjKwU1ybwxgo2V4k1lWRkROBdBUVWfEMDYiIiqnCu9QFZE0AC8B+LuLuoNEZJGILCooKKjooomIyIGb5L4ZQFPLcBOzzKcGgJMAzBWRdQBOBzDVbqeqqr6pql1UtUt2dnb5oyYiorDcJPc8AG1EpKWIZAK4FsBU30hV3aOq9VW1haq2AJALoI+qLopLxEREFFHE5K6qxQCGAJgJ4GcAk1R1uYg8LiJ94h0gERFFL8NNJVX9FMCnQWUjHOqeX/GwiIioIniGKhFRCmJyJyJKQUzuREQpiMmdiCgFMbkTEaUgJnciohTE5E5ElIKY3ImIUhCTOxFRCmJyJyJKQUzuREQpiMmdiCgFMbkTEaUgJnciohTE5E5ElIKY3ImIUhCTOxFRCmJyJyJKQUzuREQpyHvJPSvLeM5wdftXIqIjkvcy5D/+AdSoAVx/fbIjISKqtLyX3GvVAp59NtlREBFVat7rliEiooiY3ImIUhCTOxFRCmJyJyJKQUzuREQpiMmdiCgFMbkTEaUgJnciohQkqpqcBYsUAFhfzsnrA9gew3BihXFFp7LGBVTe2BhXdFIxruaqmh2pUtKSe0WIyCJV7ZLsOIIxruhU1riAyhsb44rOkRwXu2WIiFIQkzsRUQryanJ/M9kBOGBc0amscQGVNzbGFZ0jNi5P9rkTEVF4Xm25ExFRGJ5L7iLSS0RWiUi+iAxP8LKbisgcEVkhIstF5G6zfKSIbBaRpebjEss0D5ixrhKRi+MY2zoRWWYuf5FZVldEvhCRX83nOma5iMgrZlw/isipcYrpeMs6WSoihSJyTzLWl4i8LSLbROQnS1nU60dEbjLr/yoiN8UprudFZKW57E9EpLZZ3kJEDlrW22jLNJ3Nzz/fjF3iEFfUn1usf68OcU20xLRORJaa5YlcX065IXnfMVX1zANAOoDVAI4DkAngBwDtErj8RgBONV/XAPALgHYARgIYZlO/nRljFoCWZuzpcYptHYD6QWXPARhuvh4O4Fnz9SUAPgMgAE4HsCBBn93vAJonY30BOBfAqQB+Ku/6AVAXwBrzuY75uk4c4roIQIb5+llLXC2s9YLms9CMVczYe8chrqg+t3j8Xu3iChr/IoARSVhfTrkhad8xr7XcuwHIV9U1qloEYAKAvolauKpuUdUl5uu9AH4G0DjMJH0BTFDVP1R1LYB8GO8hUfoCeMd8/Q6AKyzl76ohF0BtEWkU51guBLBaVcOduBa39aWq8wDstFleNOvnYgBfqOpOVd0F4AsAvWIdl6rOUtViczAXQJNw8zBjq6mquWpkiHct7yVmcYXh9LnF/PcaLi6z9f1nAB+Em0ec1pdTbkjad8xryb0xgI2W4U0In1zjRkRaADgFwAKzaIi5efW2b9MLiY1XAcwSkcUiMsgsa6CqW8zXvwNokIS4fK5F4I8u2esLiH79JGO93QKjhefTUkS+F5GvReQcs6yxGUsi4ormc0v0+joHwFZV/dVSlvD1FZQbkvYd81pyrxRE5GgAHwG4R1ULAbwOoBWAkwFsgbFpmGhnq+qpAHoDGCwi51pHmi2UpBwaJSKZAPoAmGwWVYb1FSCZ68eJiDwEoBjA+2bRFgDNVPUUAH8DMF5EaiYwpEr3uQW5DoENiISvL5vcUCbR3zGvJffNAJpahpuYZQkjIlVgfHjvq+rHAKCqW1W1RFVLAbwFf1dCwuJV1c3m8zYAn5gxbPV1t5jP2xIdl6k3gCWqutWMMenryxTt+klYfCIyAMBlAP5iJgWY3R47zNeLYfRntzVjsHbdxCWucnxuiVxfGQD6AZhoiTeh68suNyCJ3zGvJfc8AG1EpKXZGrwWwNRELdzs0xsL4GdVfclSbu2vvhKAb0/+VADXikiWiLQE0AbGjpxYx1VdRGr4XsPYIfeTuXzf3vabAEyxxNXf3GN/OoA9lk3HeAhoUSV7fVlEu35mArhIROqYXRIXmWUxJSK9ANwPoI+qHrCUZ4tIuvn6OBjrZ40ZW6GInG5+R/tb3kss44r2c0vk77UHgJWqWtbdksj15ZQbkMzvWEX2ECfjAWMv8y8w/oUfSvCyz4axWfUjgKXm4xIA7wFYZpZPBdDIMs1DZqyrUME98mHiOg7GkQg/AFjuWy8A6gGYDeBXAF8CqGuWC4BRZlzLAHSJ4zqrDmAHgFqWsoSvLxh/LlsAHIbRj/nX8qwfGH3g+ebj5jjFlQ+j39X3HRtt1r3K/HyXAlgC4HLLfLrASLarAfwb5gmKMY4r6s8t1r9Xu7jM8nEAbg+qm8j15ZQbkvYd4xmqREQpyGvdMkRE5AKTOxFRCmJyJyJKQUzuREQpiMmdiCgFMbkTEaUgJnciohTE5E5ElIL+H10tNSjNasdqAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 432x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.plot(H.history[\"acc\"])\n",
    "plt.plot(H.history[\"val_acc\"], 'r')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Predict"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(254,)"
      ]
     },
     "execution_count": 39,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "y_test.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 97,
   "metadata": {},
   "outputs": [],
   "source": [
    "y_pred_softmax = model.predict(X_test)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 98,
   "metadata": {},
   "outputs": [],
   "source": [
    "import numpy as np"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 99,
   "metadata": {},
   "outputs": [],
   "source": [
    "y_pred = np.argmax(y_pred_softmax, axis=1)"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python (spinningup)",
   "language": "python",
   "name": "spinningup"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.8"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}
